[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:04:15 dist-test-slave-jq4t krb5kdc[15518](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:04:15 dist-test-slave-jq4t krb5kdc[15518](info): set up 2 sockets
Aug 10 21:04:15 dist-test-slave-jq4t krb5kdc[15518](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260810 21:04:16.499580 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.457s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:04:16 dist-test-slave-jq4t krb5kdc[15518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:04:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:04:16.635957 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:42393
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:39689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:42393
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:16.730221 15538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:16.730484 15538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:16.730527 15538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:16.731915 15538 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:16.731974 15538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:16.731988 15538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:16.732002 15538 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:16.732015 15538 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:16.734181 15538 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:39689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:42393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:42393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:16.734679 15538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:16.735064 15538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:16.744521 15553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:16.744554 15550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:16.744521 15551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:16.745517 15538 server_base.cc:1034] running on GCE node
I20260810 21:04:16.746027 15538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:16.746505 15538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:16.747704 15538 hybrid_clock.cc:648] HybridClock initialized: now 1786395856747661 us; error 99 us; skew 500 ppm
Aug 10 21:04:16 dist-test-slave-jq4t krb5kdc[15518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395856, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:16.751119 15538 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:04:16.752063 15538 webserver.cc:460] Webserver started at http://127.15.37.62:38855/ using document root <none> and password file <none>
I20260810 21:04:16.752526 15538 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:16.752627 15538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:16.752863 15538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:16.754428 15538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "70341ab26af44e028410c5c681ca940c"
format_stamp: "Formatted at 2026-08-10 21:04:16 on dist-test-slave-jq4t"
server_key: "ea57a59644ce1d13c26efe87aec0f02b"
server_key_iv: "b8aae6b898b79f4ffd5d4d48584b2ce4"
server_key_version: "encryptionkey@0"
I20260810 21:04:16.755162 15538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "70341ab26af44e028410c5c681ca940c"
format_stamp: "Formatted at 2026-08-10 21:04:16 on dist-test-slave-jq4t"
server_key: "ea57a59644ce1d13c26efe87aec0f02b"
server_key_iv: "b8aae6b898b79f4ffd5d4d48584b2ce4"
server_key_version: "encryptionkey@0"
I20260810 21:04:16.757596 15538 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.005s sys 0.000s
I20260810 21:04:16.758893 15562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:16.759192 15538 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:16.759321 15538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "70341ab26af44e028410c5c681ca940c"
format_stamp: "Formatted at 2026-08-10 21:04:16 on dist-test-slave-jq4t"
server_key: "ea57a59644ce1d13c26efe87aec0f02b"
server_key_iv: "b8aae6b898b79f4ffd5d4d48584b2ce4"
server_key_version: "encryptionkey@0"
I20260810 21:04:16.759443 15538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:16.775727 15538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:16.779314 15538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:16.779582 15538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:16.786345 15538 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:42393
I20260810 21:04:16.786435 15644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:42393 every 8 connection(s)
I20260810 21:04:16.787154 15538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:16.789214 15645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:16.793215 15645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c: Bootstrap starting.
I20260810 21:04:16.794332 15645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:16.794838 15645 log.cc:824] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:16.794904 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 15538
I20260810 21:04:16.795065 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:16.795821 15508 external_mini_cluster.cc:1428] Setting key c07d8fbc6ee43739e844d4ad84eada01
I20260810 21:04:16.796022 15645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c: No bootstrap required, opened a new log
I20260810 21:04:16.798719 15645 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70341ab26af44e028410c5c681ca940c" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42393 } }
I20260810 21:04:16.799010 15645 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:16.799117 15645 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70341ab26af44e028410c5c681ca940c, State: Initialized, Role: FOLLOWER
I20260810 21:04:16.799310 15645 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70341ab26af44e028410c5c681ca940c" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42393 } }
I20260810 21:04:16.799443 15645 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:16.799492 15645 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:16.799551 15645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:16.800806 15645 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70341ab26af44e028410c5c681ca940c" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42393 } }
I20260810 21:04:16.801044 15645 leader_election.cc:302] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70341ab26af44e028410c5c681ca940c; no voters:
I20260810 21:04:16.801337 15645 leader_election.cc:288] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:16.801362 15652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:16.801769 15645 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:16.803591 15652 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [term 1 LEADER]: Becoming Leader. State: Replica: 70341ab26af44e028410c5c681ca940c, State: Running, Role: LEADER
I20260810 21:04:16.803831 15652 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70341ab26af44e028410c5c681ca940c" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42393 } }
I20260810 21:04:16.804585 15667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70341ab26af44e028410c5c681ca940c. Latest consensus state: current_term: 1 leader_uuid: "70341ab26af44e028410c5c681ca940c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70341ab26af44e028410c5c681ca940c" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42393 } } }
I20260810 21:04:16.804728 15667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:16.804843 15653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70341ab26af44e028410c5c681ca940c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70341ab26af44e028410c5c681ca940c" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42393 } } }
I20260810 21:04:16.805012 15653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:16.805406 15670 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:16.806751 15670 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:16.809907 15670 catalog_manager.cc:1347] Generated new cluster ID: 3318d9b773384929870f134b4eaa12f0
I20260810 21:04:16.810130 15670 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:04:16 dist-test-slave-jq4t krb5kdc[15518](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:16.821569 15649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:16.797375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44042 (local address 127.15.37.62:42393)
0810 21:04:16.797724 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:16.797733 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:16.798095 (+ 362us) server_negotiation.cc:407] Connection header received
0810 21:04:16.800389 (+ 2294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:16.800395 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:16.800552 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:16.800705 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:16.803453 (+ 2748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:16.805598 (+ 2145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:16.807993 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:16.808951 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:16.809154 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:16.815483 (+ 6329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:16.815502 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:16.815503 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:16.815520 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:16.818765 (+ 3245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:16.819384 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:16.819388 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:16.819388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:16.819624 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:16.819958 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:16.819959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:16.819960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:16.820433 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:16.820870 (+ 437us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:16.821018 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 21:04:16.821254 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":125,"threads_started":1}
I20260810 21:04:16.823498 15670 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:16.824566 15670 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:16.834617 15670 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70341ab26af44e028410c5c681ca940c: Generated new TSK 0
I20260810 21:04:16.834882 15670 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:04:16.871912 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42393
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:39689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:16.993255 15681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:16.993539 15681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:16.993570 15681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:16.995147 15681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:16.995221 15681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:16.995254 15681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:04:16.997386 15681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:39689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42393
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:16.997809 15681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:16.998129 15681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:17.005358 15686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:17.005532 15687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:17.005419 15690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:17.005918 15681 server_base.cc:1034] running on GCE node
I20260810 21:04:17.006181 15681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:17.006484 15681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:17.007679 15681 hybrid_clock.cc:648] HybridClock initialized: now 1786395857007657 us; error 52 us; skew 500 ppm
Aug 10 21:04:17 dist-test-slave-jq4t krb5kdc[15518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395857, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:17.011209 15681 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:04:17.012286 15681 webserver.cc:460] Webserver started at http://127.15.37.1:45343/ using document root <none> and password file <none>
I20260810 21:04:17.012669 15681 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:17.012758 15681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:17.012940 15681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:17.014181 15681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "8f5ae8eea6a040ce9dbc6732dca974a3"
format_stamp: "Formatted at 2026-08-10 21:04:17 on dist-test-slave-jq4t"
server_key: "d4c78165e48485cb7585231ff92db05d"
server_key_iv: "6e94a7e7606e1766c7e63e958bdb5c50"
server_key_version: "encryptionkey@0"
I20260810 21:04:17.014627 15681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "8f5ae8eea6a040ce9dbc6732dca974a3"
format_stamp: "Formatted at 2026-08-10 21:04:17 on dist-test-slave-jq4t"
server_key: "d4c78165e48485cb7585231ff92db05d"
server_key_iv: "6e94a7e7606e1766c7e63e958bdb5c50"
server_key_version: "encryptionkey@0"
I20260810 21:04:17.016325 15681 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260810 21:04:17.017341 15702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:17.017654 15681 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:17.017793 15681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "8f5ae8eea6a040ce9dbc6732dca974a3"
format_stamp: "Formatted at 2026-08-10 21:04:17 on dist-test-slave-jq4t"
server_key: "d4c78165e48485cb7585231ff92db05d"
server_key_iv: "6e94a7e7606e1766c7e63e958bdb5c50"
server_key_version: "encryptionkey@0"
I20260810 21:04:17.017889 15681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:17.038355 15681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:17.040812 15681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:17.041023 15681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:17.041409 15681 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:17.041860 15681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:17.041968 15681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:17.042047 15681 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:17.042078 15681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:17.052845 15681 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:43317
I20260810 21:04:17.052902 15897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:43317 every 8 connection(s)
I20260810 21:04:17.053329 15681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:04:17.059912 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 15681
I20260810 21:04:17.060043 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:04:17.060348 15508 external_mini_cluster.cc:1428] Setting key feedab4fceaeafe15faf0935d3079a77
Aug 10 21:04:17 dist-test-slave-jq4t krb5kdc[15518](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395857, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:17.065264 15649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:17.054520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:36553 (local address 127.15.37.62:42393)
0810 21:04:17.054599 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:17.054602 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:17.054821 (+ 219us) server_negotiation.cc:407] Connection header received
0810 21:04:17.055334 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:17.055335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:17.055353 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:17.055409 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:17.056656 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.057208 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.058328 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.058543 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.058614 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:17.061683 (+ 3069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:17.061685 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:17.061685 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:17.061694 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:17.063596 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:17.064072 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:17.064073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:17.064073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:17.064142 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:17.064434 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:17.064435 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:17.064435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:17.064616 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:17.064691 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:17.065050 (+ 359us) server_negotiation.cc:299] Negotiation successful
0810 21:04:17.065158 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 21:04:17.065510 15903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:17.054488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42393 (local address 127.15.37.1:36553)
0810 21:04:17.054670 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:17.054721 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:17.055224 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:17.055471 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:17.055475 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:17.056232 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:17.056466 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:17.056471 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.057309 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.057310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:17.058208 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:17.058210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.058643 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.058644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:17.058768 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:17.059405 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:17.059416 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:17.061562 (+ 2146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:17.063697 (+ 2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:17.063708 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:17.063711 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:17.063981 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:17.064222 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:17.064223 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:17.064224 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:17.064350 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:17.064694 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:17.064703 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:17.064894 (+ 191us) client_negotiation.cc:769] Sending connection context
0810 21:04:17.065010 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 21:04:17.065202 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":108,"threads_started":1}
I20260810 21:04:17.066131 15899 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42393
I20260810 21:04:17.066256 15899 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:17.066469 15899 heartbeater.cc:511] Master 127.15.37.62:42393 requested a full tablet report, sending...
I20260810 21:04:17.067488 15585 ts_manager.cc:194] Registered new tserver with Master: 8f5ae8eea6a040ce9dbc6732dca974a3 (127.15.37.1:43317)
I20260810 21:04:17.068317 15585 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:36553
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:04:17.093518 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42393
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:39689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:17.215514 15907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:17.215761 15907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:17.215790 15907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:17.217401 15907 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:17.217461 15907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:17.217509 15907 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:04:17.219422 15907 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:39689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42393
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15907
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:17.219719 15907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:17.220013 15907 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:17.226284 15916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:17.226306 15922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:17.226392 15907 server_base.cc:1034] running on GCE node
W20260810 21:04:17.226318 15917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:17.226684 15907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:17.226991 15907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:17.228179 15907 hybrid_clock.cc:648] HybridClock initialized: now 1786395857228159 us; error 44 us; skew 500 ppm
Aug 10 21:04:17 dist-test-slave-jq4t krb5kdc[15518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395857, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:17.230958 15907 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:04:17.231500 15907 webserver.cc:460] Webserver started at http://127.15.37.2:33677/ using document root <none> and password file <none>
I20260810 21:04:17.231772 15907 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:17.231845 15907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:17.232025 15907 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:17.233260 15907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "e71f0b9e096b4057b33fd55386f15bce"
format_stamp: "Formatted at 2026-08-10 21:04:17 on dist-test-slave-jq4t"
server_key: "6345764fdee669c6868116f85b8104c6"
server_key_iv: "bce1631ca155ff0f9f68ea586a91c48e"
server_key_version: "encryptionkey@0"
I20260810 21:04:17.233680 15907 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "e71f0b9e096b4057b33fd55386f15bce"
format_stamp: "Formatted at 2026-08-10 21:04:17 on dist-test-slave-jq4t"
server_key: "6345764fdee669c6868116f85b8104c6"
server_key_iv: "bce1631ca155ff0f9f68ea586a91c48e"
server_key_version: "encryptionkey@0"
I20260810 21:04:17.235357 15907 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:04:17.236377 15931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:17.236615 15907 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:17.236745 15907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "e71f0b9e096b4057b33fd55386f15bce"
format_stamp: "Formatted at 2026-08-10 21:04:17 on dist-test-slave-jq4t"
server_key: "6345764fdee669c6868116f85b8104c6"
server_key_iv: "bce1631ca155ff0f9f68ea586a91c48e"
server_key_version: "encryptionkey@0"
I20260810 21:04:17.236832 15907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:17.262777 15907 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:17.265502 15907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:17.265700 15907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:17.266156 15907 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:17.266592 15907 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:17.266654 15907 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:17.266700 15907 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:17.266745 15907 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:17.283280 15907 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:44665
I20260810 21:04:17.283378 16116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:44665 every 8 connection(s)
I20260810 21:04:17.283829 15907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
Aug 10 21:04:17 dist-test-slave-jq4t krb5kdc[15518](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395857, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:17.292290 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 15907
I20260810 21:04:17.292377 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:04:17.292619 15508 external_mini_cluster.cc:1428] Setting key 496f5c65f4cc43ecacab3cd271ab2eec
I20260810 21:04:17.296069 15649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:17.284832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:48225 (local address 127.15.37.62:42393)
0810 21:04:17.284908 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:17.284910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:17.285288 (+ 378us) server_negotiation.cc:407] Connection header received
0810 21:04:17.286098 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:17.286099 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:17.286110 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:17.286165 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:17.287325 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.287874 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.289179 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.289396 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.289460 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:17.292179 (+ 2719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:17.292181 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:17.292181 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:17.292189 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:17.294027 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:17.294611 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:17.294611 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:17.294612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:17.294670 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:17.295049 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:17.295051 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:17.295051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:17.295181 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:17.295251 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:17.295779 (+ 528us) server_negotiation.cc:299] Negotiation successful
0810 21:04:17.295923 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 21:04:17.296535 16122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:17.284828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42393 (local address 127.15.37.2:48225)
0810 21:04:17.285131 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:17.285171 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:17.286000 (+ 829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:17.286249 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:17.286252 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:17.286940 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:17.287204 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:17.287209 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.288006 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.288007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:17.289085 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:17.289088 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.289482 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.289483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:17.289619 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:17.290228 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:17.290237 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:17.292037 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:17.294122 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:17.294131 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:17.294134 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:17.294512 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:17.294751 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:17.294752 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:17.294753 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:17.294942 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:17.295269 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:17.295283 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:17.295537 (+ 254us) client_negotiation.cc:769] Sending connection context
0810 21:04:17.295740 (+ 203us) client_negotiation.cc:240] Negotiation successful
0810 21:04:17.296027 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":183,"threads_started":1}
I20260810 21:04:17.297127 16120 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42393
I20260810 21:04:17.297256 16120 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:17.297510 16120 heartbeater.cc:511] Master 127.15.37.62:42393 requested a full tablet report, sending...
I20260810 21:04:17.297996 15585 ts_manager.cc:194] Registered new tserver with Master: e71f0b9e096b4057b33fd55386f15bce (127.15.37.2:44665)
I20260810 21:04:17.298429 15585 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:48225
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:04:17.324013 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42393
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:39689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:17.445329 16127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:17.445583 16127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:17.445613 16127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:17.446954 16127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:17.447000 16127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:17.447029 16127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:04:17.448725 16127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:39689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42393
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:17.449020 16127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:17.449271 16127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:17.455965 16133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:17.456216 16127 server_base.cc:1034] running on GCE node
W20260810 21:04:17.456024 16139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:17.455920 16135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:17.456650 16127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:17.456929 16127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:17.458092 16127 hybrid_clock.cc:648] HybridClock initialized: now 1786395857458074 us; error 50 us; skew 500 ppm
Aug 10 21:04:17 dist-test-slave-jq4t krb5kdc[15518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395857, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:17.461455 16127 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:04:17.462072 16127 webserver.cc:460] Webserver started at http://127.15.37.3:36205/ using document root <none> and password file <none>
I20260810 21:04:17.462347 16127 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:17.462445 16127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:17.462627 16127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:17.464062 16127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "25d21916f7874d629a3977bfdd8a8104"
format_stamp: "Formatted at 2026-08-10 21:04:17 on dist-test-slave-jq4t"
server_key: "c5fe97a61e55b9c17b7368a63d503ef5"
server_key_iv: "652a2db7a5422352f007d83cc36a978b"
server_key_version: "encryptionkey@0"
I20260810 21:04:17.464466 16127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "25d21916f7874d629a3977bfdd8a8104"
format_stamp: "Formatted at 2026-08-10 21:04:17 on dist-test-slave-jq4t"
server_key: "c5fe97a61e55b9c17b7368a63d503ef5"
server_key_iv: "652a2db7a5422352f007d83cc36a978b"
server_key_version: "encryptionkey@0"
I20260810 21:04:17.466372 16127 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260810 21:04:17.467248 16149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:17.467439 16127 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:17.467551 16127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "25d21916f7874d629a3977bfdd8a8104"
format_stamp: "Formatted at 2026-08-10 21:04:17 on dist-test-slave-jq4t"
server_key: "c5fe97a61e55b9c17b7368a63d503ef5"
server_key_iv: "652a2db7a5422352f007d83cc36a978b"
server_key_version: "encryptionkey@0"
I20260810 21:04:17.467643 16127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:17.483765 16127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:17.486433 16127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:17.486652 16127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:17.487089 16127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:17.487466 16127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:17.487526 16127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:17.487564 16127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:17.487613 16127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:17.502092 16127 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:42877
I20260810 21:04:17.502198 16328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:42877 every 8 connection(s)
I20260810 21:04:17.502669 16127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
Aug 10 21:04:17 dist-test-slave-jq4t krb5kdc[15518](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395857, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:17.512284 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 16127
I20260810 21:04:17.512408 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:04:17.512653 15508 external_mini_cluster.cc:1428] Setting key efd4bd8c347f93eb5159428c177a14df
I20260810 21:04:17.514964 15649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:17.503838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:40905 (local address 127.15.37.62:42393)
0810 21:04:17.503917 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:17.503920 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:17.504311 (+ 391us) server_negotiation.cc:407] Connection header received
0810 21:04:17.505038 (+ 727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:17.505039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:17.505051 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:17.505107 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:17.506288 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.506812 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.508112 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.508319 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.508377 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:17.511255 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:17.511257 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:17.511257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:17.511265 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:17.513300 (+ 2035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:17.513962 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:17.513962 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:17.513963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:17.514022 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:17.514323 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:17.514324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:17.514325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:17.514474 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:17.514539 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:17.514816 (+ 277us) server_negotiation.cc:299] Negotiation successful
0810 21:04:17.514896 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 21:04:17.515367 16332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:17.503825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42393 (local address 127.15.37.3:40905)
0810 21:04:17.504171 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:17.504211 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:17.504928 (+ 717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:17.505167 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:17.505171 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:17.505826 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:17.506177 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:17.506183 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.506927 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.506928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:17.508018 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:17.508021 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.508422 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.508424 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:17.508669 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:17.509370 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:17.509380 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:17.511134 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:17.513401 (+ 2267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:17.513411 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:17.513414 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:17.513861 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:17.514090 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:17.514091 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:17.514092 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:17.514254 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:17.514548 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:17.514553 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:17.514689 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 21:04:17.514784 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 21:04:17.514936 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":219,"threads_started":1}
I20260810 21:04:17.516105 16329 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42393
I20260810 21:04:17.516206 16329 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:17.516418 16329 heartbeater.cc:511] Master 127.15.37.62:42393 requested a full tablet report, sending...
I20260810 21:04:17.516965 15585 ts_manager.cc:194] Registered new tserver with Master: 25d21916f7874d629a3977bfdd8a8104 (127.15.37.3:42877)
I20260810 21:04:17.517364 15585 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:40905
I20260810 21:04:17.525774 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 21:04:17 dist-test-slave-jq4t krb5kdc[15518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395857, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 21:04:17 dist-test-slave-jq4t krb5kdc[15518](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395857, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.37.1@KRBTEST.COM
I20260810 21:04:17.555912 16343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:17.546648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57750 (local address 127.15.37.1:43317)
0810 21:04:17.546986 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:17.546991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:17.547004 (+ 13us) server_negotiation.cc:407] Connection header received
0810 21:04:17.547034 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:17.547036 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:17.547052 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:17.547188 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:17.547836 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.548700 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.549465 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.549810 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.549899 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:17.552702 (+ 2803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:17.552712 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:17.552712 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:17.552720 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:17.554519 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:17.554940 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:17.554943 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:17.554943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:17.555002 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:17.555238 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:17.555240 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:17.555240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:17.555418 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:17.555544 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:17.555679 (+ 135us) server_negotiation.cc:299] Negotiation successful
0810 21:04:17.555766 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":245,"threads_started":1}
W20260810 21:04:17.556586 15750 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57750
Aug 10 21:04:17 dist-test-slave-jq4t krb5kdc[15518](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 21:04:17 dist-test-slave-jq4t krb5kdc[15518](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.1@KRBTEST.COM
I20260810 21:04:17.590178 16343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:17.580361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57764 (local address 127.15.37.1:43317)
0810 21:04:17.580439 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:17.580441 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:17.580515 (+ 74us) server_negotiation.cc:407] Connection header received
0810 21:04:17.582278 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:17.582279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:17.582296 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:17.582433 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:17.583113 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.583636 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.584428 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:17.584713 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:17.584795 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:17.587307 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:17.587309 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:17.587310 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:17.587322 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:17.588904 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:17.589306 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:17.589307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:17.589307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:17.589371 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:17.589589 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:17.589590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:17.589591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:17.589704 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:17.589813 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:17.589968 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 21:04:17.590059 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 21:04:17.590868 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 15681
I20260810 21:04:17.606128 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 15907
I20260810 21:04:17.618461 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 16127
I20260810 21:04:17.634372 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 15538
2026-08-10T21:04:17Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2634 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:04:17 dist-test-slave-jq4t krb5kdc[16353](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:04:17 dist-test-slave-jq4t krb5kdc[16353](info): set up 2 sockets
Aug 10 21:04:17 dist-test-slave-jq4t krb5kdc[16353](info): commencing operation
krb5kdc: starting...
W20260810 21:04:18.959630 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.292s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:04:19 dist-test-slave-jq4t krb5kdc[16353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:04:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:04:19.092123 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:35907
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:46333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:35907
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:19.180233 16370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:19.180636 16370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:19.180681 16370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:19.182054 16370 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:19.182132 16370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:19.182157 16370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:19.182189 16370 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:19.182217 16370 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:19.183831 16370 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:46333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:35907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:35907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16370
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:19.184147 16370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:19.184413 16370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:19.190022 16377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:19.190043 16370 server_base.cc:1034] running on GCE node
W20260810 21:04:19.190025 16381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:19.190039 16389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:19.190583 16370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:19.190953 16370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:19.192132 16370 hybrid_clock.cc:648] HybridClock initialized: now 1786395859192121 us; error 51 us; skew 500 ppm
Aug 10 21:04:19 dist-test-slave-jq4t krb5kdc[16353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395859, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:19.194921 16370 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:04:19.195408 16370 webserver.cc:460] Webserver started at http://127.15.37.62:46765/ using document root <none> and password file <none>
I20260810 21:04:19.195684 16370 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:19.195756 16370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:19.195909 16370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:19.197100 16370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "388b8af25e164cabbc4000e8cb22b7e2"
format_stamp: "Formatted at 2026-08-10 21:04:19 on dist-test-slave-jq4t"
server_key: "e563199dea183c1bee5402837d36802f"
server_key_iv: "39f8c83611ce88918af3ee236803e265"
server_key_version: "encryptionkey@0"
I20260810 21:04:19.197484 16370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "388b8af25e164cabbc4000e8cb22b7e2"
format_stamp: "Formatted at 2026-08-10 21:04:19 on dist-test-slave-jq4t"
server_key: "e563199dea183c1bee5402837d36802f"
server_key_iv: "39f8c83611ce88918af3ee236803e265"
server_key_version: "encryptionkey@0"
I20260810 21:04:19.198896 16370 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:04:19.199649 16400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:19.199831 16370 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 21:04:19.199944 16370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "388b8af25e164cabbc4000e8cb22b7e2"
format_stamp: "Formatted at 2026-08-10 21:04:19 on dist-test-slave-jq4t"
server_key: "e563199dea183c1bee5402837d36802f"
server_key_iv: "39f8c83611ce88918af3ee236803e265"
server_key_version: "encryptionkey@0"
I20260810 21:04:19.200040 16370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:19.220127 16370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:19.222795 16370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:19.222985 16370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:19.228085 16370 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:35907
I20260810 21:04:19.228165 16485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:35907 every 8 connection(s)
I20260810 21:04:19.228632 16370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:19.229671 16486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:19.232198 16486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2: Bootstrap starting.
I20260810 21:04:19.232939 16486 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:19.233280 16486 log.cc:824] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:19.234122 16486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2: No bootstrap required, opened a new log
I20260810 21:04:19.235882 16486 raft_consensus.cc:348] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "388b8af25e164cabbc4000e8cb22b7e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35907 } }
I20260810 21:04:19.236050 16486 raft_consensus.cc:374] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:19.236074 16486 raft_consensus.cc:729] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388b8af25e164cabbc4000e8cb22b7e2, State: Initialized, Role: FOLLOWER
I20260810 21:04:19.236253 16486 consensus_queue.cc:260] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "388b8af25e164cabbc4000e8cb22b7e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35907 } }
I20260810 21:04:19.236339 16486 raft_consensus.cc:388] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:19.236364 16486 raft_consensus.cc:482] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:19.236421 16486 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:19.237113 16486 raft_consensus.cc:504] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "388b8af25e164cabbc4000e8cb22b7e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35907 } }
I20260810 21:04:19.237210 16486 leader_election.cc:302] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 388b8af25e164cabbc4000e8cb22b7e2; no voters:
I20260810 21:04:19.237438 16486 leader_election.cc:288] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:19.237498 16489 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:19.237730 16489 raft_consensus.cc:686] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [term 1 LEADER]: Becoming Leader. State: Replica: 388b8af25e164cabbc4000e8cb22b7e2, State: Running, Role: LEADER
I20260810 21:04:19.237789 16486 sys_catalog.cc:564] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:19.237830 16489 consensus_queue.cc:237] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "388b8af25e164cabbc4000e8cb22b7e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35907 } }
I20260810 21:04:19.238240 16492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 388b8af25e164cabbc4000e8cb22b7e2. Latest consensus state: current_term: 1 leader_uuid: "388b8af25e164cabbc4000e8cb22b7e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "388b8af25e164cabbc4000e8cb22b7e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35907 } } }
I20260810 21:04:19.238348 16492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:19.238507 16491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "388b8af25e164cabbc4000e8cb22b7e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "388b8af25e164cabbc4000e8cb22b7e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35907 } } }
I20260810 21:04:19.238591 16491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:19.238639 16502 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:19.238811 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 16370
I20260810 21:04:19.238909 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:19.239114 15508 external_mini_cluster.cc:1428] Setting key cf4933b7c0321631c47e28a9571caa05
I20260810 21:04:19.239238 16502 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:19.241178 16502 catalog_manager.cc:1347] Generated new cluster ID: 20dbc83a9cde4614af75e2bf01c4245f
I20260810 21:04:19.241245 16502 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:04:19 dist-test-slave-jq4t krb5kdc[16353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:19.250986 16518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.239819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40642 (local address 127.15.37.62:35907)
0810 21:04:19.240039 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:19.240051 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:19.240091 (+ 40us) server_negotiation.cc:407] Connection header received
0810 21:04:19.240237 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:19.240245 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:19.240308 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:19.240614 (+ 306us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:19.241290 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.242495 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.243285 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.243736 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.243885 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.246445 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:19.246451 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:19.246452 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:19.246466 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:19.249219 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.249647 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.249651 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.249651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.249774 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.250009 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.250010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.250010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.250292 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:19.250493 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:19.250566 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 21:04:19.250731 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":74,"threads_started":1}
I20260810 21:04:19.258831 16502 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:19.259600 16502 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:19.263942 16502 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 388b8af25e164cabbc4000e8cb22b7e2: Generated new TSK 0
I20260810 21:04:19.264163 16502 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:04:19.302158 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:35907
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:46333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:19.411248 16527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:19.411525 16527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:19.411571 16527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:19.412936 16527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:19.413012 16527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:19.413070 16527 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:04:19.414835 16527 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:46333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:35907
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:19.415184 16527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:19.415460 16527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:19.421643 16533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:19.421746 16534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:19.421856 16527 server_base.cc:1034] running on GCE node
W20260810 21:04:19.421639 16537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:19.422211 16527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:19.422503 16527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:19.423697 16527 hybrid_clock.cc:648] HybridClock initialized: now 1786395859423693 us; error 44 us; skew 500 ppm
Aug 10 21:04:19 dist-test-slave-jq4t krb5kdc[16353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395859, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:19.426585 16527 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:04:19.427027 16527 webserver.cc:460] Webserver started at http://127.15.37.1:41801/ using document root <none> and password file <none>
I20260810 21:04:19.427304 16527 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:19.427352 16527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:19.427526 16527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:19.428740 16527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "a0eff54a60e84efeb636df156143af7b"
format_stamp: "Formatted at 2026-08-10 21:04:19 on dist-test-slave-jq4t"
server_key: "015cf0d2ec59dc3cb390f0ad879b7cbf"
server_key_iv: "2d46858ab84d4e720f65cde900c16970"
server_key_version: "encryptionkey@0"
I20260810 21:04:19.429137 16527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "a0eff54a60e84efeb636df156143af7b"
format_stamp: "Formatted at 2026-08-10 21:04:19 on dist-test-slave-jq4t"
server_key: "015cf0d2ec59dc3cb390f0ad879b7cbf"
server_key_iv: "2d46858ab84d4e720f65cde900c16970"
server_key_version: "encryptionkey@0"
I20260810 21:04:19.430617 16527 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:04:19.431421 16551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:19.431620 16527 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:19.431736 16527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "a0eff54a60e84efeb636df156143af7b"
format_stamp: "Formatted at 2026-08-10 21:04:19 on dist-test-slave-jq4t"
server_key: "015cf0d2ec59dc3cb390f0ad879b7cbf"
server_key_iv: "2d46858ab84d4e720f65cde900c16970"
server_key_version: "encryptionkey@0"
I20260810 21:04:19.431816 16527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:19.477573 16527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:19.480285 16527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:19.480496 16527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:19.480779 16527 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:19.481128 16527 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:19.481187 16527 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:19.481235 16527 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:19.481257 16527 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:19.487323 16527 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:40339
I20260810 21:04:19.487371 16730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:40339 every 8 connection(s)
I20260810 21:04:19.487800 16527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:04:19.490353 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 16527
I20260810 21:04:19.490482 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:04:19.490676 15508 external_mini_cluster.cc:1428] Setting key 2b76daf8c673f61699bada87adb15695
Aug 10 21:04:19 dist-test-slave-jq4t krb5kdc[16353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395859, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:19.500427 16518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.488822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:50065 (local address 127.15.37.62:35907)
0810 21:04:19.488918 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:19.488921 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:19.489175 (+ 254us) server_negotiation.cc:407] Connection header received
0810 21:04:19.490455 (+ 1280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:19.490457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:19.490477 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:19.490537 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:19.491575 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.492347 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.493779 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.493993 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.494054 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.496985 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:19.496988 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:19.496988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:19.496996 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:19.498592 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.499217 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.499219 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.499219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.499286 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.499644 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.499645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.499645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.499766 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:19.499824 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:19.500240 (+ 416us) server_negotiation.cc:299] Negotiation successful
0810 21:04:19.500353 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 21:04:19.500742 16736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.488773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:35907 (local address 127.15.37.1:50065)
0810 21:04:19.489008 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:19.489053 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:19.490310 (+ 1257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:19.490677 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:19.490681 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:19.491136 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:19.491451 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.491459 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.492459 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.492459 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.493675 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.493679 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.494105 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.494106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.494269 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.494892 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:19.494904 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:19.496875 (+ 1971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:19.498705 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:19.498717 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:19.498720 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:19.499102 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:19.499386 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:19.499387 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:19.499388 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:19.499565 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:19.499838 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:19.499847 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:19.500053 (+ 206us) client_negotiation.cc:769] Sending connection context
0810 21:04:19.500200 (+ 147us) client_negotiation.cc:240] Negotiation successful
0810 21:04:19.500405 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":150,"threads_started":1}
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
I20260810 21:04:19.501454 16731 heartbeater.cc:347] Connected to a master server at 127.15.37.62:35907
I20260810 21:04:19.501593 16731 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:19.501802 16731 heartbeater.cc:511] Master 127.15.37.62:35907 requested a full tablet report, sending...
I20260810 21:04:19.502455 16426 ts_manager.cc:194] Registered new tserver with Master: a0eff54a60e84efeb636df156143af7b (127.15.37.1:40339)
I20260810 21:04:19.503141 16426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:50065
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:04:19.522071 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:35907
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:46333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:19.612668 16740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:19.612907 16740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:19.612936 16740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:19.614161 16740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:19.614203 16740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:19.614233 16740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:04:19.615824 16740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:46333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:35907
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:19.616051 16740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:19.616263 16740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:19.622663 16756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:19.622684 16752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:19.622690 16753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:19.623070 16740 server_base.cc:1034] running on GCE node
I20260810 21:04:19.623299 16740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:19.623587 16740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:19.624780 16740 hybrid_clock.cc:648] HybridClock initialized: now 1786395859624775 us; error 42 us; skew 500 ppm
Aug 10 21:04:19 dist-test-slave-jq4t krb5kdc[16353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395859, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:19.627745 16740 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:04:19.628381 16740 webserver.cc:460] Webserver started at http://127.15.37.2:38179/ using document root <none> and password file <none>
I20260810 21:04:19.628715 16740 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:19.628793 16740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:19.628953 16740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:19.630127 16740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "641345b07d43459db7d1f449664816b9"
format_stamp: "Formatted at 2026-08-10 21:04:19 on dist-test-slave-jq4t"
server_key: "e177adfacb142710584c12d9528db725"
server_key_iv: "1efa77c78390e3ef6605330dd838ab25"
server_key_version: "encryptionkey@0"
I20260810 21:04:19.630533 16740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "641345b07d43459db7d1f449664816b9"
format_stamp: "Formatted at 2026-08-10 21:04:19 on dist-test-slave-jq4t"
server_key: "e177adfacb142710584c12d9528db725"
server_key_iv: "1efa77c78390e3ef6605330dd838ab25"
server_key_version: "encryptionkey@0"
I20260810 21:04:19.632032 16740 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:19.633023 16766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:19.633278 16740 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 21:04:19.633401 16740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "641345b07d43459db7d1f449664816b9"
format_stamp: "Formatted at 2026-08-10 21:04:19 on dist-test-slave-jq4t"
server_key: "e177adfacb142710584c12d9528db725"
server_key_iv: "1efa77c78390e3ef6605330dd838ab25"
server_key_version: "encryptionkey@0"
I20260810 21:04:19.633486 16740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:19.641873 16740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:19.644672 16740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:19.644861 16740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:19.645160 16740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:19.645524 16740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:19.645581 16740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:19.645617 16740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:19.645644 16740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:19.652691 16740 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:34905
I20260810 21:04:19.652755 16957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:34905 every 8 connection(s)
I20260810 21:04:19.653158 16740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:04:19.659153 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 16740
I20260810 21:04:19.659291 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:04:19.659472 15508 external_mini_cluster.cc:1428] Setting key cb5d87d0e13e0d3a726638f378a79d0f
Aug 10 21:04:19 dist-test-slave-jq4t krb5kdc[16353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395859, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:19.664412 16518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.654090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:35125 (local address 127.15.37.62:35907)
0810 21:04:19.654169 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:19.654172 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:19.654364 (+ 192us) server_negotiation.cc:407] Connection header received
0810 21:04:19.655388 (+ 1024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:19.655390 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:19.655413 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:19.655469 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:19.656210 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.656834 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.657940 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.658149 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.658264 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.660956 (+ 2692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:19.660958 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:19.660958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:19.660965 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:19.662760 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.663196 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.663197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.663198 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.663276 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.663629 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.663630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.663630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.663795 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:19.663872 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:19.664167 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 21:04:19.664271 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 21:04:19.664444 16960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.654054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:35907 (local address 127.15.37.2:35125)
0810 21:04:19.654224 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:19.654273 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:19.655262 (+ 989us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:19.655558 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:19.655569 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:19.655848 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:19.656082 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.656086 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.656941 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.656942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.657816 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.657818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.658273 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.658274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.658415 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.659082 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:19.659091 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:19.660819 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:19.662858 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:19.662866 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:19.662868 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:19.663111 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:19.663423 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:19.663424 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:19.663424 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:19.663546 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:19.663867 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:19.663872 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:19.664024 (+ 152us) client_negotiation.cc:769] Sending connection context
0810 21:04:19.664120 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 21:04:19.664267 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
I20260810 21:04:19.665459 16958 heartbeater.cc:347] Connected to a master server at 127.15.37.62:35907
I20260810 21:04:19.665583 16958 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:19.665830 16958 heartbeater.cc:511] Master 127.15.37.62:35907 requested a full tablet report, sending...
I20260810 21:04:19.666440 16426 ts_manager.cc:194] Registered new tserver with Master: 641345b07d43459db7d1f449664816b9 (127.15.37.2:34905)
I20260810 21:04:19.666867 16426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:35125
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:04:19.687561 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:35907
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:46333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:19.777139 16965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:19.777424 16965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:19.777469 16965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:19.778705 16965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:19.778782 16965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:19.778829 16965 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:04:19.780471 16965 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:46333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:35907
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:19.780841 16965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:19.781105 16965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:19.786580 16980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:19.786720 16965 server_base.cc:1034] running on GCE node
W20260810 21:04:19.786629 16982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:19.786793 16979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:19.787134 16965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:19.787405 16965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:19.788563 16965 hybrid_clock.cc:648] HybridClock initialized: now 1786395859788544 us; error 44 us; skew 500 ppm
Aug 10 21:04:19 dist-test-slave-jq4t krb5kdc[16353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395859, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:19.791790 16965 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:04:19.792438 16965 webserver.cc:460] Webserver started at http://127.15.37.3:46139/ using document root <none> and password file <none>
I20260810 21:04:19.792758 16965 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:19.792829 16965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:19.792979 16965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:19.794370 16965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "91bd51b3bac84552b885966f8aa7a7b9"
format_stamp: "Formatted at 2026-08-10 21:04:19 on dist-test-slave-jq4t"
server_key: "32a91745645d20dc424ea3ce0aad5a17"
server_key_iv: "9d1efa621123979d9118df097b2e75ba"
server_key_version: "encryptionkey@0"
I20260810 21:04:19.794699 16965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "91bd51b3bac84552b885966f8aa7a7b9"
format_stamp: "Formatted at 2026-08-10 21:04:19 on dist-test-slave-jq4t"
server_key: "32a91745645d20dc424ea3ce0aad5a17"
server_key_iv: "9d1efa621123979d9118df097b2e75ba"
server_key_version: "encryptionkey@0"
I20260810 21:04:19.796268 16965 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:04:19.797364 16994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:19.797629 16965 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:19.797715 16965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "91bd51b3bac84552b885966f8aa7a7b9"
format_stamp: "Formatted at 2026-08-10 21:04:19 on dist-test-slave-jq4t"
server_key: "32a91745645d20dc424ea3ce0aad5a17"
server_key_iv: "9d1efa621123979d9118df097b2e75ba"
server_key_version: "encryptionkey@0"
I20260810 21:04:19.797778 16965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:19.808221 16965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:19.810938 16965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:19.811074 16965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:19.811344 16965 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:19.811728 16965 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:19.811775 16965 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:19.811800 16965 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:19.811848 16965 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:19.819556 16965 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:33229
I20260810 21:04:19.819660 17174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:33229 every 8 connection(s)
I20260810 21:04:19.820016 16965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:04:19.823853 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 16965
I20260810 21:04:19.823954 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:04:19.824137 15508 external_mini_cluster.cc:1428] Setting key 18833d6f4e770af6686489e42087703d
Aug 10 21:04:19 dist-test-slave-jq4t krb5kdc[16353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395859, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:19.830614 16518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.820926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:57229 (local address 127.15.37.62:35907)
0810 21:04:19.820997 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:19.820999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:19.821187 (+ 188us) server_negotiation.cc:407] Connection header received
0810 21:04:19.822183 (+ 996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:19.822185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:19.822197 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:19.822254 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:19.822943 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.823460 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.824902 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.825119 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.825234 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.827525 (+ 2291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:19.827527 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:19.827528 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:19.827537 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:19.829035 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.829502 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.829504 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.829504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.829570 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.829844 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.829846 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.829846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.829990 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:19.830069 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:19.830411 (+ 342us) server_negotiation.cc:299] Negotiation successful
0810 21:04:19.830510 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 21:04:19.830858 17178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.820895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:35907 (local address 127.15.37.3:57229)
0810 21:04:19.821070 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:19.821112 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:19.822071 (+ 959us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:19.822337 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:19.822340 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:19.822636 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:19.822848 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.822853 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.823549 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.823550 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.824829 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.824833 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.825244 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.825245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.825433 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.825967 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:19.825976 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:19.827401 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:19.829135 (+ 1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:19.829145 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:19.829148 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:19.829413 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:19.829649 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:19.829649 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:19.829650 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:19.829772 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:19.830072 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:19.830079 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:19.830238 (+ 159us) client_negotiation.cc:769] Sending connection context
0810 21:04:19.830393 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 21:04:19.830580 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":106,"threads_started":1}
I20260810 21:04:19.831583 17176 heartbeater.cc:347] Connected to a master server at 127.15.37.62:35907
I20260810 21:04:19.831718 17176 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:19.831931 17176 heartbeater.cc:511] Master 127.15.37.62:35907 requested a full tablet report, sending...
I20260810 21:04:19.832458 16426 ts_manager.cc:194] Registered new tserver with Master: 91bd51b3bac84552b885966f8aa7a7b9 (127.15.37.3:33229)
I20260810 21:04:19.832937 16426 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:57229
I20260810 21:04:19.836185 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:04:19.845669 16518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.838774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40648 (local address 127.15.37.62:35907)
0810 21:04:19.838847 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:19.838850 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:19.839054 (+ 204us) server_negotiation.cc:407] Connection header received
0810 21:04:19.839097 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:19.839098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:19.839109 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:19.839163 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:19.839958 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.840536 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.841279 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.841479 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.841542 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.842945 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:19.842947 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:19.842947 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:19.842955 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:19.844467 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.844851 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.844852 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.844852 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.844908 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.845117 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.845117 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.845118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.845281 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:19.845359 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:19.845471 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 21:04:19.845543 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 21:04:19.848749 16426 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40648:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:19.850651 16426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:19.858726 17198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.854409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57776 (local address 127.15.37.3:33229)
0810 21:04:19.854731 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:19.854736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:19.854746 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:04:19.854795 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:19.854797 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:19.854810 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:19.854903 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:19.855219 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.856375 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.857719 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.858256 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.858353 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.858418 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:19.858582 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 21:04:19.858624 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":98,"threads_started":1}
I20260810 21:04:19.858728 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.854205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:33229 (local address 127.0.0.1:57776)
0810 21:04:19.854396 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:19.854444 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:19.854535 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:19.854932 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:19.854935 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:19.854937 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:19.855046 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.855049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.856538 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.856539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.857611 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.857614 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.858352 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.858353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.858438 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.858453 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 21:04:19.858561 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 21:04:19.858624 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":75,"thread_start_us":73,"threads_started":1}
I20260810 21:04:19.858915 17201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.854544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51088 (local address 127.15.37.2:34905)
0810 21:04:19.854718 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:19.854724 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:19.854784 (+ 60us) server_negotiation.cc:407] Connection header received
0810 21:04:19.854862 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:19.854864 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:19.854885 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:19.854975 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:19.855144 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.855979 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.857532 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.858280 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.858356 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.858430 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:19.858782 (+ 352us) server_negotiation.cc:299] Negotiation successful
0810 21:04:19.858836 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":98,"threads_started":1}
I20260810 21:04:19.858917 17192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.854233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:40339 (local address 127.0.0.1:41490)
0810 21:04:19.854601 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:19.854613 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:19.854676 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:19.855310 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:19.855311 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:19.855313 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:19.855366 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.855367 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.856630 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.856631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.857735 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.857738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.858684 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.858685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.858754 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.858758 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:19.858809 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 21:04:19.858844 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":2,"thread_start_us":100,"threads_started":1}
I20260810 21:04:19.858741 17197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.854267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:34905 (local address 127.0.0.1:51088)
0810 21:04:19.854729 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:19.854739 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:19.854795 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:19.854974 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:19.854975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:19.854977 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:19.855063 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.855065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.856116 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.856117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.857438 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.857441 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.858472 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.858473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.858539 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.858544 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:04:19.858595 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 21:04:19.858640 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":97,"threads_started":1}
I20260810 21:04:19.859261 17200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.854530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41490 (local address 127.15.37.1:40339)
0810 21:04:19.855068 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:19.855072 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:19.855082 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:04:19.855123 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:19.855125 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:19.855140 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:19.855215 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:19.855465 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.856531 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.857822 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.858527 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.858596 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.858649 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:19.859104 (+ 455us) server_negotiation.cc:299] Negotiation successful
0810 21:04:19.859174 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":76,"threads_started":1}
I20260810 21:04:19.859977 17067 tablet_service.cc:1467] Processing CreateTablet for tablet ab889bac2dbb493c90d9eb8293dcfd51 (DEFAULT_TABLE table=test-table [id=058080bcaf144117a144488ffb689f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:19.859980 16841 tablet_service.cc:1467] Processing CreateTablet for tablet ab889bac2dbb493c90d9eb8293dcfd51 (DEFAULT_TABLE table=test-table [id=058080bcaf144117a144488ffb689f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:19.859980 16620 tablet_service.cc:1467] Processing CreateTablet for tablet ab889bac2dbb493c90d9eb8293dcfd51 (DEFAULT_TABLE table=test-table [id=058080bcaf144117a144488ffb689f1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:19.860383 17067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab889bac2dbb493c90d9eb8293dcfd51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:19.860384 16620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab889bac2dbb493c90d9eb8293dcfd51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:19.860384 16841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab889bac2dbb493c90d9eb8293dcfd51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:19.863831 17202 tablet_bootstrap.cc:492] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9: Bootstrap starting.
I20260810 21:04:19.864547 17204 tablet_bootstrap.cc:492] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b: Bootstrap starting.
I20260810 21:04:19.864662 17205 tablet_bootstrap.cc:492] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9: Bootstrap starting.
I20260810 21:04:19.864864 17202 tablet_bootstrap.cc:654] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:19.865224 17204 tablet_bootstrap.cc:654] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:19.865800 17204 log.cc:824] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:19.865887 17202 log.cc:824] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:19.865975 17205 tablet_bootstrap.cc:654] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:19.866844 17202 tablet_bootstrap.cc:492] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9: No bootstrap required, opened a new log
I20260810 21:04:19.866948 17202 ts_tablet_manager.cc:1397] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:04:19.866997 17204 tablet_bootstrap.cc:492] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b: No bootstrap required, opened a new log
I20260810 21:04:19.867038 17205 log.cc:824] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:19.867064 17204 ts_tablet_manager.cc:1397] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 21:04:19.869596 17205 tablet_bootstrap.cc:492] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9: No bootstrap required, opened a new log
I20260810 21:04:19.869683 17205 ts_tablet_manager.cc:1397] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260810 21:04:19.870009 17202 raft_consensus.cc:348] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91bd51b3bac84552b885966f8aa7a7b9" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33229 } } peers { permanent_uuid: "641345b07d43459db7d1f449664816b9" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 34905 } } peers { permanent_uuid: "a0eff54a60e84efeb636df156143af7b" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40339 } }
I20260810 21:04:19.870227 17202 raft_consensus.cc:374] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:19.870278 17202 raft_consensus.cc:729] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91bd51b3bac84552b885966f8aa7a7b9, State: Initialized, Role: FOLLOWER
I20260810 21:04:19.870414 17202 consensus_queue.cc:260] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91bd51b3bac84552b885966f8aa7a7b9" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33229 } } peers { permanent_uuid: "641345b07d43459db7d1f449664816b9" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 34905 } } peers { permanent_uuid: "a0eff54a60e84efeb636df156143af7b" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40339 } }
I20260810 21:04:19.870962 17176 heartbeater.cc:503] Master 127.15.37.62:35907 was elected leader, sending a full tablet report...
I20260810 21:04:19.870779 17204 raft_consensus.cc:348] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91bd51b3bac84552b885966f8aa7a7b9" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33229 } } peers { permanent_uuid: "641345b07d43459db7d1f449664816b9" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 34905 } } peers { permanent_uuid: "a0eff54a60e84efeb636df156143af7b" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40339 } }
I20260810 21:04:19.871073 17204 raft_consensus.cc:374] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:19.871134 17204 raft_consensus.cc:729] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0eff54a60e84efeb636df156143af7b, State: Initialized, Role: FOLLOWER
I20260810 21:04:19.871299 17204 consensus_queue.cc:260] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91bd51b3bac84552b885966f8aa7a7b9" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33229 } } peers { permanent_uuid: "641345b07d43459db7d1f449664816b9" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 34905 } } peers { permanent_uuid: "a0eff54a60e84efeb636df156143af7b" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40339 } }
I20260810 21:04:19.870952 17202 ts_tablet_manager.cc:1428] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260810 21:04:19.871755 17204 ts_tablet_manager.cc:1428] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260810 21:04:19.871984 16731 heartbeater.cc:503] Master 127.15.37.62:35907 was elected leader, sending a full tablet report...
I20260810 21:04:19.873977 17205 raft_consensus.cc:348] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91bd51b3bac84552b885966f8aa7a7b9" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33229 } } peers { permanent_uuid: "641345b07d43459db7d1f449664816b9" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 34905 } } peers { permanent_uuid: "a0eff54a60e84efeb636df156143af7b" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40339 } }
I20260810 21:04:19.874212 17205 raft_consensus.cc:374] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:19.874238 17205 raft_consensus.cc:729] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641345b07d43459db7d1f449664816b9, State: Initialized, Role: FOLLOWER
I20260810 21:04:19.874364 17205 consensus_queue.cc:260] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91bd51b3bac84552b885966f8aa7a7b9" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33229 } } peers { permanent_uuid: "641345b07d43459db7d1f449664816b9" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 34905 } } peers { permanent_uuid: "a0eff54a60e84efeb636df156143af7b" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40339 } }
I20260810 21:04:19.874763 17205 ts_tablet_manager.cc:1428] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 21:04:19.874796 16958 heartbeater.cc:503] Master 127.15.37.62:35907 was elected leader, sending a full tablet report...
W20260810 21:04:19.903849 16959 tablet.cc:2369] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:04:19.925741 17218 raft_consensus.cc:482] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:19.925945 17218 raft_consensus.cc:504] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91bd51b3bac84552b885966f8aa7a7b9" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33229 } } peers { permanent_uuid: "641345b07d43459db7d1f449664816b9" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 34905 } } peers { permanent_uuid: "a0eff54a60e84efeb636df156143af7b" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40339 } }
I20260810 21:04:19.926626 17218 leader_election.cc:288] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 641345b07d43459db7d1f449664816b9 (127.15.37.2:34905), a0eff54a60e84efeb636df156143af7b (127.15.37.1:40339)
I20260810 21:04:19.930744 17200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.927217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:60297 (local address 127.15.37.1:40339)
0810 21:04:19.927290 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:19.927292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:19.927301 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:04:19.927356 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:19.927357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:19.927380 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:19.927454 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:19.927865 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.928445 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.929706 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.930270 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.930329 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.930340 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:19.930644 (+ 304us) server_negotiation.cc:299] Negotiation successful
0810 21:04:19.930687 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 21:04:19.930737 17178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.926996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:40339 (local address 127.15.37.3:60297)
0810 21:04:19.927070 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:19.927084 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:19.927147 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:19.927492 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:19.927494 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:19.927497 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:19.927718 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.927721 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.928604 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.928605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.929586 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.929589 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.930377 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.930378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.930527 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.930532 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:04:19.930606 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 21:04:19.930651 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 21:04:19.931483 17201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.927254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:45033 (local address 127.15.37.2:34905)
0810 21:04:19.927303 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:19.927305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:19.927507 (+ 202us) server_negotiation.cc:407] Connection header received
0810 21:04:19.927538 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:19.927539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:19.927553 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:19.927680 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:19.928044 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.928690 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.930092 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.930753 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.930848 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.930860 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:19.931338 (+ 478us) server_negotiation.cc:299] Negotiation successful
0810 21:04:19.931418 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 21:04:19.931414 16652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab889bac2dbb493c90d9eb8293dcfd51" candidate_uuid: "91bd51b3bac84552b885966f8aa7a7b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eff54a60e84efeb636df156143af7b" is_pre_election: true
I20260810 21:04:19.931515 17222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.926996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:34905 (local address 127.15.37.3:45033)
0810 21:04:19.927381 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:19.927392 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:19.927449 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:19.927704 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:19.927705 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:19.927707 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:19.927949 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.927951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.928802 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.928803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.929965 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:19.929968 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.931017 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.931019 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:19.931223 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.931228 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:04:19.931304 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 21:04:19.931368 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":19,"thread_start_us":225,"threads_started":1}
I20260810 21:04:19.931654 16652 raft_consensus.cc:2454] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91bd51b3bac84552b885966f8aa7a7b9 in term 0.
I20260810 21:04:19.932001 16875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab889bac2dbb493c90d9eb8293dcfd51" candidate_uuid: "91bd51b3bac84552b885966f8aa7a7b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641345b07d43459db7d1f449664816b9" is_pre_election: true
I20260810 21:04:19.932067 16995 leader_election.cc:302] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91bd51b3bac84552b885966f8aa7a7b9, a0eff54a60e84efeb636df156143af7b; no voters:
I20260810 21:04:19.932176 16875 raft_consensus.cc:2454] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91bd51b3bac84552b885966f8aa7a7b9 in term 0.
I20260810 21:04:19.932219 17218 raft_consensus.cc:2781] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:19.932291 17218 raft_consensus.cc:482] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:19.932335 17218 raft_consensus.cc:3037] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:19.933424 17218 raft_consensus.cc:504] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91bd51b3bac84552b885966f8aa7a7b9" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33229 } } peers { permanent_uuid: "641345b07d43459db7d1f449664816b9" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 34905 } } peers { permanent_uuid: "a0eff54a60e84efeb636df156143af7b" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40339 } }
I20260810 21:04:19.933609 17218 leader_election.cc:288] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [CANDIDATE]: Term 1 election: Requested vote from peers 641345b07d43459db7d1f449664816b9 (127.15.37.2:34905), a0eff54a60e84efeb636df156143af7b (127.15.37.1:40339)
I20260810 21:04:19.933748 16875 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab889bac2dbb493c90d9eb8293dcfd51" candidate_uuid: "91bd51b3bac84552b885966f8aa7a7b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "641345b07d43459db7d1f449664816b9"
I20260810 21:04:19.933789 16652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab889bac2dbb493c90d9eb8293dcfd51" candidate_uuid: "91bd51b3bac84552b885966f8aa7a7b9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0eff54a60e84efeb636df156143af7b"
I20260810 21:04:19.933849 16875 raft_consensus.cc:3037] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:19.933902 16652 raft_consensus.cc:3037] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:19.935217 16875 raft_consensus.cc:2454] T ab889bac2dbb493c90d9eb8293dcfd51 P 641345b07d43459db7d1f449664816b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91bd51b3bac84552b885966f8aa7a7b9 in term 1.
I20260810 21:04:19.935218 16652 raft_consensus.cc:2454] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91bd51b3bac84552b885966f8aa7a7b9 in term 1.
I20260810 21:04:19.935459 16996 leader_election.cc:302] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 641345b07d43459db7d1f449664816b9, 91bd51b3bac84552b885966f8aa7a7b9; no voters:
I20260810 21:04:19.935611 17218 raft_consensus.cc:2781] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:19.935855 17218 raft_consensus.cc:686] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [term 1 LEADER]: Becoming Leader. State: Replica: 91bd51b3bac84552b885966f8aa7a7b9, State: Running, Role: LEADER
I20260810 21:04:19.936048 17218 consensus_queue.cc:237] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91bd51b3bac84552b885966f8aa7a7b9" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33229 } } peers { permanent_uuid: "641345b07d43459db7d1f449664816b9" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 34905 } } peers { permanent_uuid: "a0eff54a60e84efeb636df156143af7b" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40339 } }
I20260810 21:04:19.937369 16424 catalog_manager.cc:5495] T ab889bac2dbb493c90d9eb8293dcfd51 P 91bd51b3bac84552b885966f8aa7a7b9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91bd51b3bac84552b885966f8aa7a7b9 (127.15.37.3). New cstate: current_term: 1 leader_uuid: "91bd51b3bac84552b885966f8aa7a7b9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91bd51b3bac84552b885966f8aa7a7b9" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "641345b07d43459db7d1f449664816b9" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 34905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0eff54a60e84efeb636df156143af7b" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40339 } health_report { overall_health: UNKNOWN } } }
Aug 10 21:04:19 dist-test-slave-jq4t krb5kdc[16353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.1@KRBTEST.COM
I20260810 21:04:19.962878 17200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.953919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41506 (local address 127.15.37.1:40339)
0810 21:04:19.954009 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:19.954011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:19.954260 (+ 249us) server_negotiation.cc:407] Connection header received
0810 21:04:19.954311 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:19.954312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:19.954325 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:19.954382 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:19.955163 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.955704 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.956557 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.956797 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.956875 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.959681 (+ 2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:19.959696 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:19.959696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:19.959703 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:19.961781 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.962155 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.962159 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.962159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.962222 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.962401 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.962402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.962402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.962560 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:19.962670 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:19.962729 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 21:04:19.962796 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
Aug 10 21:04:19 dist-test-slave-jq4t krb5kdc[16353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395859, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260810 21:04:19.988821 16733 tablet.cc:2369] T ab889bac2dbb493c90d9eb8293dcfd51 P a0eff54a60e84efeb636df156143af7b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 21:04:19 dist-test-slave-jq4t krb5kdc[16353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395859, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.37.1@KRBTEST.COM
I20260810 21:04:19.993439 17200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:19.985158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41512 (local address 127.15.37.1:40339)
0810 21:04:19.985230 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:19.985232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:19.985377 (+ 145us) server_negotiation.cc:407] Connection header received
0810 21:04:19.985437 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:19.985439 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:19.985450 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:19.985504 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:19.986141 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.986631 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.987438 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:19.987639 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:19.987700 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:19.990554 (+ 2854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:19.990555 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:19.990556 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:19.990564 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:19.992016 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.992557 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.992558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.992558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.992623 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:19.992837 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:19.992839 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:19.992839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:19.992961 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:19.993060 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:19.993234 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 21:04:19.993310 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Aug 10 21:04:20 dist-test-slave-jq4t krb5kdc[16353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 21:04:20 dist-test-slave-jq4t krb5kdc[16353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.1@KRBTEST.COM
I20260810 21:04:20.025810 17200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:20.015644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41514 (local address 127.15.37.1:40339)
0810 21:04:20.015713 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:20.015716 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:20.015857 (+ 141us) server_negotiation.cc:407] Connection header received
0810 21:04:20.015952 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:20.015954 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:20.015972 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:20.016058 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:20.016758 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:20.017264 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:20.018413 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:20.018767 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:20.018870 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:20.022416 (+ 3546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:20.022419 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:20.022419 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:20.022429 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:20.024217 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:20.024904 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:20.024906 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:20.024907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:20.024980 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:20.025200 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:20.025201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:20.025201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:20.025354 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:20.025456 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:20.025556 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 21:04:20.025659 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 21:04:20.026837 16592 tablet_service.cc:2908] Rejecting scan request for tablet ab889bac2dbb493c90d9eb8293dcfd51: Uninitialized: clean time has not yet been initialized
I20260810 21:04:20.028193 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 16527
I20260810 21:04:20.046793 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 16740
I20260810 21:04:20.059909 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 16965
I20260810 21:04:20.075228 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 16370
2026-08-10T21:04:20Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2436 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:04:20 dist-test-slave-jq4t krb5kdc[17241](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:04:20 dist-test-slave-jq4t krb5kdc[17241](info): set up 2 sockets
Aug 10 21:04:20 dist-test-slave-jq4t krb5kdc[17241](info): commencing operation
krb5kdc: starting...
W20260810 21:04:21.377873 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.274s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:04:21 dist-test-slave-jq4t krb5kdc[17241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:04:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:04:21.509197 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:41325
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:46581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:41325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:21.594924 17269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:21.595147 17269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:21.595171 17269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:21.596278 17269 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:21.596316 17269 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 21:04:21.596329 17269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:21.596342 17269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:21.596354 17269 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:21.596372 17269 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:21.597887 17269 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:46581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:41325
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:41325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:21.598106 17269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:21.598294 17269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:21.603736 17283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:21.603749 17269 server_base.cc:1034] running on GCE node
W20260810 21:04:21.603713 17280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:21.603695 17279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:21.604281 17269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:21.604672 17269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:21.605886 17269 hybrid_clock.cc:648] HybridClock initialized: now 1786395861605872 us; error 38 us; skew 500 ppm
Aug 10 21:04:21 dist-test-slave-jq4t krb5kdc[17241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395861, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:21.608757 17269 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:04:21.609321 17269 webserver.cc:460] Webserver started at http://127.15.37.62:42855/ using document root <none> and password file <none>
I20260810 21:04:21.609570 17269 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:21.609642 17269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:21.609797 17269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:21.610949 17269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "0d40c1d139594f1dbd158ed47bd79be2"
format_stamp: "Formatted at 2026-08-10 21:04:21 on dist-test-slave-jq4t"
server_key: "cbbb7334fba1c4e5ddbfc9daa72ced96"
server_key_iv: "2641437fcbdb945c31dfd16547dcc103"
server_key_version: "encryptionkey@0"
I20260810 21:04:21.611349 17269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "0d40c1d139594f1dbd158ed47bd79be2"
format_stamp: "Formatted at 2026-08-10 21:04:21 on dist-test-slave-jq4t"
server_key: "cbbb7334fba1c4e5ddbfc9daa72ced96"
server_key_iv: "2641437fcbdb945c31dfd16547dcc103"
server_key_version: "encryptionkey@0"
I20260810 21:04:21.612957 17269 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:21.613794 17292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:21.614132 17269 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:21.614251 17269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "0d40c1d139594f1dbd158ed47bd79be2"
format_stamp: "Formatted at 2026-08-10 21:04:21 on dist-test-slave-jq4t"
server_key: "cbbb7334fba1c4e5ddbfc9daa72ced96"
server_key_iv: "2641437fcbdb945c31dfd16547dcc103"
server_key_version: "encryptionkey@0"
I20260810 21:04:21.614337 17269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:21.628264 17269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:21.630489 17269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:21.630686 17269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:21.636113 17269 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:41325
I20260810 21:04:21.636176 17394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:41325 every 8 connection(s)
I20260810 21:04:21.636561 17269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:21.637253 17398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:21.640339 17398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2: Bootstrap starting.
I20260810 21:04:21.641044 17398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:21.641368 17398 log.cc:824] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:21.642159 17398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2: No bootstrap required, opened a new log
I20260810 21:04:21.644585 17398 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d40c1d139594f1dbd158ed47bd79be2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41325 } }
I20260810 21:04:21.644760 17398 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:21.644800 17398 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d40c1d139594f1dbd158ed47bd79be2, State: Initialized, Role: FOLLOWER
I20260810 21:04:21.645026 17398 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d40c1d139594f1dbd158ed47bd79be2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41325 } }
I20260810 21:04:21.645129 17398 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:21.645177 17398 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:21.645226 17398 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:21.645345 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 17269
I20260810 21:04:21.645442 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:21.645622 15508 external_mini_cluster.cc:1428] Setting key e191591ed18beecff795e3f08d06c7bc
I20260810 21:04:21.645992 17398 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d40c1d139594f1dbd158ed47bd79be2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41325 } }
I20260810 21:04:21.646132 17398 leader_election.cc:302] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d40c1d139594f1dbd158ed47bd79be2; no voters:
I20260810 21:04:21.646385 17398 leader_election.cc:288] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:21.646415 17405 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:21.646631 17405 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [term 1 LEADER]: Becoming Leader. State: Replica: 0d40c1d139594f1dbd158ed47bd79be2, State: Running, Role: LEADER
I20260810 21:04:21.646742 17398 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:21.646770 17405 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d40c1d139594f1dbd158ed47bd79be2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41325 } }
I20260810 21:04:21.647143 17405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d40c1d139594f1dbd158ed47bd79be2. Latest consensus state: current_term: 1 leader_uuid: "0d40c1d139594f1dbd158ed47bd79be2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d40c1d139594f1dbd158ed47bd79be2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41325 } } }
I20260810 21:04:21.647277 17405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:21.647161 17408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d40c1d139594f1dbd158ed47bd79be2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d40c1d139594f1dbd158ed47bd79be2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41325 } } }
I20260810 21:04:21.647414 17408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:21.647640 17423 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:21.648275 17423 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:21.650188 17423 catalog_manager.cc:1347] Generated new cluster ID: f5be7c1a88dd49c2b0d8fd488d9be93d
I20260810 21:04:21.650245 17423 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:04:21 dist-test-slave-jq4t krb5kdc[17241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:21.658627 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:21.646286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58674 (local address 127.15.37.62:41325)
0810 21:04:21.646546 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:21.646557 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:21.646751 (+ 194us) server_negotiation.cc:407] Connection header received
0810 21:04:21.646923 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:21.646930 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:21.646998 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:21.647148 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:21.648129 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:21.649679 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:21.650740 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:21.651384 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:21.651504 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:21.654351 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:21.654357 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:21.654358 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:21.654372 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:21.656610 (+ 2238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:21.657028 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:21.657032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:21.657033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:21.657167 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:21.657372 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:21.657373 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:21.657373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:21.657685 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:21.658171 (+ 486us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:21.658241 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 21:04:21.658390 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":148,"threads_started":1}
I20260810 21:04:21.670747 17423 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:21.671352 17423 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:21.681162 17423 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2: Generated new TSK 0
I20260810 21:04:21.681429 17423 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:04:21.720237 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:41325
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:46581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:21.812866 17445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:21.813128 17445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:21.813170 17445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:21.814391 17445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:21.814471 17445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:21.814509 17445 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 21:04:21.814568 17445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:04:21.816054 17445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:46581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.37.62:41325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:21.816339 17445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:21.816653 17445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:21.822126 17456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:21.822131 17453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:21.822131 17458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:21.822417 17445 server_base.cc:1034] running on GCE node
I20260810 21:04:21.822671 17445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:21.822929 17445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:21.824098 17445 hybrid_clock.cc:648] HybridClock initialized: now 1786395861824099 us; error 41 us; skew 500 ppm
Aug 10 21:04:21 dist-test-slave-jq4t krb5kdc[17241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395861, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:21.826694 17445 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:04:21.827216 17445 webserver.cc:460] Webserver started at http://127.15.37.1:34789/ using document root <none> and password file <none>
I20260810 21:04:21.827456 17445 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:21.827541 17445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:21.827696 17445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:21.828884 17445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "21ad46b4fcb04063ba392425bdb720c8"
format_stamp: "Formatted at 2026-08-10 21:04:21 on dist-test-slave-jq4t"
server_key: "5f2ed66691e73dee47d88916180a2936"
server_key_iv: "20aae974aa9dd11b5d4c7ff286dfbfff"
server_key_version: "encryptionkey@0"
I20260810 21:04:21.829260 17445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "21ad46b4fcb04063ba392425bdb720c8"
format_stamp: "Formatted at 2026-08-10 21:04:21 on dist-test-slave-jq4t"
server_key: "5f2ed66691e73dee47d88916180a2936"
server_key_iv: "20aae974aa9dd11b5d4c7ff286dfbfff"
server_key_version: "encryptionkey@0"
I20260810 21:04:21.830725 17445 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:04:21.831678 17469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:21.831943 17445 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:21.832062 17445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "21ad46b4fcb04063ba392425bdb720c8"
format_stamp: "Formatted at 2026-08-10 21:04:21 on dist-test-slave-jq4t"
server_key: "5f2ed66691e73dee47d88916180a2936"
server_key_iv: "20aae974aa9dd11b5d4c7ff286dfbfff"
server_key_version: "encryptionkey@0"
I20260810 21:04:21.832145 17445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:21.882251 17445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:21.884595 17445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:21.884768 17445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:21.885344 17445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:21.885407 17445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:21.885453 17445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:21.885483 17445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 21:04:21 dist-test-slave-jq4t krb5kdc[17241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395861, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:21.894040 17445 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:46329
I20260810 21:04:21.894201 17645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:46329 every 8 connection(s)
I20260810 21:04:21.894486 17445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:04:21.896955 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:21.886092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:53001 (local address 127.15.37.62:41325)
0810 21:04:21.886174 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:21.886178 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:21.886368 (+ 190us) server_negotiation.cc:407] Connection header received
0810 21:04:21.886976 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:21.886977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:21.886991 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:21.887063 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:21.888435 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:21.889121 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:21.890181 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:21.890461 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:21.890541 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:21.893533 (+ 2992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:21.893535 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:21.893536 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:21.893549 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:21.895353 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:21.895854 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:21.895855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:21.895856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:21.895926 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:21.896195 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:21.896196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:21.896197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:21.896335 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:21.896411 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:21.896757 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 21:04:21.896856 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 21:04:21.897171 17480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:21.886043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:41325 (local address 127.15.37.1:53001)
0810 21:04:21.886229 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:21.886274 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:21.886841 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:21.887144 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:21.887148 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:21.887656 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:21.888325 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:21.888332 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:21.889225 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:21.889226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:21.890082 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:21.890084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:21.890553 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:21.890555 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:21.890700 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:21.891337 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:21.891350 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:21.893403 (+ 2053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:21.895458 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:21.895466 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:21.895469 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:21.895757 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:21.895994 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:21.895995 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:21.895995 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:21.896120 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:21.896413 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:21.896422 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:21.896613 (+ 191us) client_negotiation.cc:769] Sending connection context
0810 21:04:21.896732 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 21:04:21.896921 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":110,"threads_started":1}
I20260810 21:04:21.897645 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 17445
I20260810 21:04:21.897756 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:04:21.897792 17647 heartbeater.cc:347] Connected to a master server at 127.15.37.62:41325
I20260810 21:04:21.897927 17647 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:21.897986 15508 external_mini_cluster.cc:1428] Setting key 7504fc4cbbcd17c46df2a33c3220031c
I20260810 21:04:21.898187 17647 heartbeater.cc:511] Master 127.15.37.62:41325 requested a full tablet report, sending...
I20260810 21:04:21.898847 17320 ts_manager.cc:194] Registered new tserver with Master: 21ad46b4fcb04063ba392425bdb720c8 (127.15.37.1:46329)
I20260810 21:04:21.899777 17320 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:53001
I20260810 21:04:21.906170 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:21.899207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:41583 (local address 127.15.37.62:41325)
0810 21:04:21.899248 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:21.899250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:21.899260 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:04:21.899329 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:21.899330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:21.899341 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:21.899407 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:21.899770 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:21.900581 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:21.901746 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:21.901944 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:21.901999 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:21.903157 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:21.903159 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:21.903159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:21.903165 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:21.904749 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:21.905198 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:21.905199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:21.905200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:21.905266 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:21.905488 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:21.905489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:21.905489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:21.905673 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:21.905762 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:21.906033 (+ 271us) server_negotiation.cc:299] Negotiation successful
0810 21:04:21.906104 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 21:04:21.906262 17655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:21.899034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:41325 (local address 127.15.37.1:41583)
0810 21:04:21.899197 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:21.899210 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:21.899264 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:21.899413 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:21.899413 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:21.899610 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:21.899689 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:21.899691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:21.900687 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:21.900688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:21.901634 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:21.901638 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:21.902022 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:21.902023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:21.902106 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:21.902579 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:21.902585 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:21.903055 (+ 470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:21.904833 (+ 1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:21.904835 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:21.904836 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:21.905101 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:21.905340 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:21.905341 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:21.905341 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:21.905419 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:21.905829 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:21.905830 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:21.905918 (+ 88us) client_negotiation.cc:769] Sending connection context
0810 21:04:21.906001 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 21:04:21.906131 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":22,"thread_start_us":84,"threads_started":1}
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:04:21.927884 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:41325
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:46581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:22.014911 17658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:22.015144 17658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:22.015173 17658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:22.016311 17658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:22.016356 17658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:22.016378 17658 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 21:04:22.016395 17658 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:04:22.018091 17658 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:46581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.37.62:41325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:22.018391 17658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:22.018682 17658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:22.024183 17664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:22.024320 17663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:22.024425 17658 server_base.cc:1034] running on GCE node
W20260810 21:04:22.024344 17667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:22.024801 17658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:22.025089 17658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:22.026255 17658 hybrid_clock.cc:648] HybridClock initialized: now 1786395862026236 us; error 42 us; skew 500 ppm
Aug 10 21:04:22 dist-test-slave-jq4t krb5kdc[17241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395862, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:22.029100 17658 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:04:22.029615 17658 webserver.cc:460] Webserver started at http://127.15.37.2:41307/ using document root <none> and password file <none>
I20260810 21:04:22.029865 17658 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:22.029946 17658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:22.030108 17658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:22.031293 17658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "8f524af15c0b4dbe9095a24c5d203fc3"
format_stamp: "Formatted at 2026-08-10 21:04:22 on dist-test-slave-jq4t"
server_key: "4544100b7e809ce06314799ee4b07f29"
server_key_iv: "84f6f0b48998112eb3b21cf29782aa67"
server_key_version: "encryptionkey@0"
I20260810 21:04:22.031701 17658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "8f524af15c0b4dbe9095a24c5d203fc3"
format_stamp: "Formatted at 2026-08-10 21:04:22 on dist-test-slave-jq4t"
server_key: "4544100b7e809ce06314799ee4b07f29"
server_key_iv: "84f6f0b48998112eb3b21cf29782aa67"
server_key_version: "encryptionkey@0"
I20260810 21:04:22.033238 17658 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260810 21:04:22.034104 17679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:22.034336 17658 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:22.034458 17658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "8f524af15c0b4dbe9095a24c5d203fc3"
format_stamp: "Formatted at 2026-08-10 21:04:22 on dist-test-slave-jq4t"
server_key: "4544100b7e809ce06314799ee4b07f29"
server_key_iv: "84f6f0b48998112eb3b21cf29782aa67"
server_key_version: "encryptionkey@0"
I20260810 21:04:22.034538 17658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:22.063942 17658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:22.066200 17658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:22.066325 17658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:22.066850 17658 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:22.066888 17658 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:22.066919 17658 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:22.066977 17658 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:22.074481 17658 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:33759
I20260810 21:04:22.074551 17853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:33759 every 8 connection(s)
I20260810 21:04:22.074882 17658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
Aug 10 21:04:22 dist-test-slave-jq4t krb5kdc[17241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395862, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:22.078534 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.067495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:60763 (local address 127.15.37.62:41325)
0810 21:04:22.067559 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:22.067561 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:22.067816 (+ 255us) server_negotiation.cc:407] Connection header received
0810 21:04:22.068345 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:22.068347 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:22.068365 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:22.068455 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:22.069446 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.070324 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.072199 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.072561 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.072630 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.075630 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:22.075631 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:22.075631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:22.075639 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:22.076984 (+ 1345us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:22.077391 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:22.077392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:22.077392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:22.077454 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:22.077739 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:22.077740 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:22.077741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:22.077889 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:22.077967 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:22.078366 (+ 399us) server_negotiation.cc:299] Negotiation successful
0810 21:04:22.078460 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 21:04:22.078655 17695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.067486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:41325 (local address 127.15.37.2:60763)
0810 21:04:22.067680 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:22.067718 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:22.068238 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:22.068577 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:22.068581 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:22.069000 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:22.069338 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.069345 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.070467 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.070469 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.072065 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.072068 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.072662 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.072663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.072843 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.073577 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:22.073589 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:22.075510 (+ 1921us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:22.077068 (+ 1558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:22.077076 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:22.077078 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:22.077314 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:22.077515 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:22.077515 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:22.077516 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:22.077631 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:22.078002 (+ 371us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:22.078010 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:22.078174 (+ 164us) client_negotiation.cc:769] Sending connection context
0810 21:04:22.078282 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 21:04:22.078428 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":113,"threads_started":1}
I20260810 21:04:22.079216 17854 heartbeater.cc:347] Connected to a master server at 127.15.37.62:41325
I20260810 21:04:22.079324 17854 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:22.079562 17854 heartbeater.cc:511] Master 127.15.37.62:41325 requested a full tablet report, sending...
I20260810 21:04:22.079982 17321 ts_manager.cc:194] Registered new tserver with Master: 8f524af15c0b4dbe9095a24c5d203fc3 (127.15.37.2:33759)
I20260810 21:04:22.080515 17321 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:60763
I20260810 21:04:22.084986 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 17658
I20260810 21:04:22.085112 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:04:22.085309 15508 external_mini_cluster.cc:1428] Setting key 6f6e3a2154aab6ca493e53b4ce9a5503
I20260810 21:04:22.086928 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.080556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:58865 (local address 127.15.37.62:41325)
0810 21:04:22.080602 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:22.080605 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:22.080756 (+ 151us) server_negotiation.cc:407] Connection header received
0810 21:04:22.080807 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:22.080808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:22.080821 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:22.080884 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:22.081344 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.081825 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.082565 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.082744 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.082794 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.083765 (+ 971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:22.083766 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:22.083766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:22.083772 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:22.085667 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:22.086100 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:22.086101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:22.086101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:22.086165 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:22.086405 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:22.086406 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:22.086406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:22.086557 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:22.086613 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:22.086795 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 21:04:22.086863 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 21:04:22.087100 17864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.080465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:41325 (local address 127.15.37.2:58865)
0810 21:04:22.080669 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:22.080682 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:22.080750 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:22.080924 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:22.080925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:22.081176 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:22.081260 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.081262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.081929 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.081930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.082489 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.082490 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.082831 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.082833 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.082903 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.083352 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:22.083358 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:22.083680 (+ 322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:22.085772 (+ 2092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:22.085773 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:22.085774 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:22.086022 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:22.086246 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:22.086247 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:22.086247 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:22.086328 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:22.086629 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:22.086630 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:22.086687 (+ 57us) client_negotiation.cc:769] Sending connection context
0810 21:04:22.086771 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 21:04:22.086911 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":3,"thread_start_us":104,"threads_started":1}
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:04:22.115936 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:41325
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:46581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:22.206830 17870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:22.207113 17870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:22.207159 17870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:22.208612 17870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:22.208667 17870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:22.208701 17870 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 21:04:22.208737 17870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:04:22.210445 17870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:46581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.37.62:41325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:22.210752 17870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:22.211045 17870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:22.216595 17875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:22.216660 17870 server_base.cc:1034] running on GCE node
W20260810 21:04:22.216595 17876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:22.216607 17879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:22.217120 17870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:22.217401 17870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:22.218588 17870 hybrid_clock.cc:648] HybridClock initialized: now 1786395862218587 us; error 43 us; skew 500 ppm
Aug 10 21:04:22 dist-test-slave-jq4t krb5kdc[17241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395862, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:22.221463 17870 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:04:22.221939 17870 webserver.cc:460] Webserver started at http://127.15.37.3:34767/ using document root <none> and password file <none>
I20260810 21:04:22.222226 17870 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:22.222272 17870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:22.222399 17870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:22.223513 17870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "f4cea1da76ae43f7be13b036f523f4b4"
format_stamp: "Formatted at 2026-08-10 21:04:22 on dist-test-slave-jq4t"
server_key: "dff1965c0b05d9b2f795b2cb9ed4cb7c"
server_key_iv: "d4834738ba80e15523fd6f540977097e"
server_key_version: "encryptionkey@0"
I20260810 21:04:22.223878 17870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "f4cea1da76ae43f7be13b036f523f4b4"
format_stamp: "Formatted at 2026-08-10 21:04:22 on dist-test-slave-jq4t"
server_key: "dff1965c0b05d9b2f795b2cb9ed4cb7c"
server_key_iv: "d4834738ba80e15523fd6f540977097e"
server_key_version: "encryptionkey@0"
I20260810 21:04:22.225363 17870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:04:22.226127 17898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:22.226329 17870 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:22.226421 17870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "f4cea1da76ae43f7be13b036f523f4b4"
format_stamp: "Formatted at 2026-08-10 21:04:22 on dist-test-slave-jq4t"
server_key: "dff1965c0b05d9b2f795b2cb9ed4cb7c"
server_key_iv: "d4834738ba80e15523fd6f540977097e"
server_key_version: "encryptionkey@0"
I20260810 21:04:22.226478 17870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:22.238646 17870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:22.240828 17870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:22.240990 17870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:22.241554 17870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:22.241600 17870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:22.241623 17870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:22.241659 17870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 21:04:22 dist-test-slave-jq4t krb5kdc[17241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395862, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:22.250155 17870 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:33567
I20260810 21:04:22.250237 18091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:33567 every 8 connection(s)
I20260810 21:04:22.250623 17870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:04:22.252641 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 17870
I20260810 21:04:22.252746 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:04:22.252915 15508 external_mini_cluster.cc:1428] Setting key f5dbbc76212ff398ddbf98e1b4fee156
I20260810 21:04:22.252942 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.242203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:56045 (local address 127.15.37.62:41325)
0810 21:04:22.242287 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:22.242289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:22.242419 (+ 130us) server_negotiation.cc:407] Connection header received
0810 21:04:22.242980 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:22.242982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:22.242999 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:22.243092 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:22.244048 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.244941 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.246193 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.246531 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.246611 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.249910 (+ 3299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:22.249912 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:22.249912 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:22.249922 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:22.251669 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:22.252039 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:22.252040 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:22.252040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:22.252091 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:22.252266 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:22.252266 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:22.252267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:22.252365 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:22.252411 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:22.252748 (+ 337us) server_negotiation.cc:299] Negotiation successful
0810 21:04:22.252840 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 21:04:22.253131 17909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.242104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:41325 (local address 127.15.37.3:56045)
0810 21:04:22.242295 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:22.242339 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:22.242832 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:22.243195 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:22.243200 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:22.243586 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:22.243890 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.243920 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.245053 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.245055 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.246029 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.246032 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.246667 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.246668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.246845 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.247603 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:22.247616 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:22.249772 (+ 2156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:22.251744 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:22.251748 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:22.251749 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:22.251977 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:22.252132 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:22.252132 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:22.252133 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:22.252231 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:22.252415 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:22.252418 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:22.252601 (+ 183us) client_negotiation.cc:769] Sending connection context
0810 21:04:22.252717 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 21:04:22.252885 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":126,"threads_started":1}
I20260810 21:04:22.253654 18092 heartbeater.cc:347] Connected to a master server at 127.15.37.62:41325
I20260810 21:04:22.253741 18092 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:22.253943 18092 heartbeater.cc:511] Master 127.15.37.62:41325 requested a full tablet report, sending...
I20260810 21:04:22.254391 17321 ts_manager.cc:194] Registered new tserver with Master: f4cea1da76ae43f7be13b036f523f4b4 (127.15.37.3:33567)
I20260810 21:04:22.254890 17321 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:56045
I20260810 21:04:22.255039 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:04:22.260900 18100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.254809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:41325 (local address 127.15.37.3:55609)
0810 21:04:22.254947 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:22.254966 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:22.255043 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:22.255217 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:22.255217 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:22.255396 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:22.255458 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.255459 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.256126 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.256127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.256741 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.256744 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.257219 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.257220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.257283 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.257733 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:22.257737 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:22.258009 (+ 272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:22.259635 (+ 1626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:22.259636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:22.259637 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:22.259901 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:22.260142 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:22.260143 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:22.260144 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:22.260220 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:22.260527 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:22.260529 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:22.260579 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 21:04:22.260662 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 21:04:22.260784 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":79,"threads_started":1}
I20260810 21:04:22.260910 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.254823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:55609 (local address 127.15.37.62:41325)
0810 21:04:22.254872 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:22.254874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:22.255017 (+ 143us) server_negotiation.cc:407] Connection header received
0810 21:04:22.255116 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:22.255117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:22.255128 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:22.255158 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:22.255540 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.256023 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.256836 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.257132 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.257202 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.258105 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:22.258107 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:22.258107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:22.258115 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:22.259547 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:22.260000 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:22.260001 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:22.260002 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:22.260057 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:22.260292 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:22.260293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:22.260294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:22.260425 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:22.260518 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:22.260703 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 21:04:22.260781 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Aug 10 21:04:22 dist-test-slave-jq4t krb5kdc[17241](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395862, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 21:04:22 dist-test-slave-jq4t krb5kdc[17241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395862, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:22.281533 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.274183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58680 (local address 127.15.37.62:41325)
0810 21:04:22.274256 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:22.274257 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:22.274265 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:04:22.274293 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:22.274293 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:22.274303 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:22.274349 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:22.274978 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.275515 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.276265 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.276463 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.276588 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.278881 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:22.278883 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:22.278884 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:22.278894 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:22.280466 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:22.280869 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:22.280870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:22.280871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:22.280932 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:22.281108 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:22.281108 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:22.281108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:22.281221 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:22.281299 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:22.281395 (+ 96us) server_negotiation.cc:299] Negotiation successful
0810 21:04:22.281462 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 21:04:22.283457 17321 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58680:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:22.285270 17321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:22.292141 18118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.287721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:33567 (local address 127.0.0.1:58292)
0810 21:04:22.287845 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:22.287888 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:22.287956 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:22.288880 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:22.288880 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:22.288882 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:22.288922 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.288923 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.290175 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.290176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.290943 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.290945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.291779 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.291780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.291872 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.291885 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 21:04:22.291989 (+ 104us) client_negotiation.cc:240] Negotiation successful
0810 21:04:22.292050 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":74,"threads_started":1}
I20260810 21:04:22.292151 18123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.287861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58292 (local address 127.15.37.3:33567)
0810 21:04:22.288705 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:22.288708 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:22.288716 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:04:22.288765 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:22.288768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:22.288783 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:22.288875 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:22.289054 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.290083 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.291083 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.291689 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.291778 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.291848 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:22.292009 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 21:04:22.292054 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":799,"thread_start_us":141,"threads_started":1}
I20260810 21:04:22.292496 18121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.287943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:33759 (local address 127.0.0.1:58708)
0810 21:04:22.288271 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:22.288277 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:22.288301 (+ 24us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:22.288990 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:22.288991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:22.288994 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:22.289027 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.289028 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.289887 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.289889 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.291241 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.291244 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.292221 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.292223 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.292299 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.292305 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 21:04:22.292339 (+ 34us) client_negotiation.cc:240] Negotiation successful
0810 21:04:22.292387 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"mutex_wait_us":6,"thread_start_us":102,"threads_started":1}
I20260810 21:04:22.292618 18125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.287839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:46329 (local address 127.0.0.1:37802)
0810 21:04:22.288175 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:22.288184 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:22.288221 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:22.288616 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:22.288620 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:22.288623 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:22.288699 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.288701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.290069 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.290070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.291237 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.291240 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.292379 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.292380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.292444 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.292447 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:04:22.292502 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 21:04:22.292545 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":98,"threads_started":1}
I20260810 21:04:22.292868 18128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.288253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58708 (local address 127.15.37.2:33759)
0810 21:04:22.288455 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:22.288459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:22.288468 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:04:22.288536 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:22.288538 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:22.288553 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:22.288972 (+ 419us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:22.289091 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.289789 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.291348 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.292115 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.292603 (+ 488us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.292675 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:22.292706 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 21:04:22.292756 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":99,"threads_started":1}
I20260810 21:04:22.293037 18126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.288111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37802 (local address 127.15.37.1:46329)
0810 21:04:22.288410 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:22.288416 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:22.288427 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:04:22.288473 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:22.288493 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:22.288510 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:22.288598 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:22.288789 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.289973 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.291359 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.292109 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.292780 (+ 671us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.292851 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:22.292881 (+ 30us) server_negotiation.cc:299] Negotiation successful
0810 21:04:22.292928 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":140,"threads_started":1}
I20260810 21:04:22.293355 17986 tablet_service.cc:1467] Processing CreateTablet for tablet df7dbfc9c89341c2b5a17bdc9e4319e1 (DEFAULT_TABLE table=test-table [id=87c0c13bd1e545b5ac61539bda0950fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:22.293499 17763 tablet_service.cc:1467] Processing CreateTablet for tablet df7dbfc9c89341c2b5a17bdc9e4319e1 (DEFAULT_TABLE table=test-table [id=87c0c13bd1e545b5ac61539bda0950fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:22.293774 17986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7dbfc9c89341c2b5a17bdc9e4319e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:22.293673 17548 tablet_service.cc:1467] Processing CreateTablet for tablet df7dbfc9c89341c2b5a17bdc9e4319e1 (DEFAULT_TABLE table=test-table [id=87c0c13bd1e545b5ac61539bda0950fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:22.293859 17763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7dbfc9c89341c2b5a17bdc9e4319e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:22.293979 17548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df7dbfc9c89341c2b5a17bdc9e4319e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:22.296887 18129 tablet_bootstrap.cc:492] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3: Bootstrap starting.
I20260810 21:04:22.297333 18130 tablet_bootstrap.cc:492] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4: Bootstrap starting.
I20260810 21:04:22.297638 18129 tablet_bootstrap.cc:654] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:22.298039 18129 log.cc:824] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:22.298321 18130 tablet_bootstrap.cc:654] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:22.298692 18130 log.cc:824] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:22.298938 18129 tablet_bootstrap.cc:492] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3: No bootstrap required, opened a new log
I20260810 21:04:22.299031 18129 ts_tablet_manager.cc:1397] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:04:22.299062 18131 tablet_bootstrap.cc:492] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8: Bootstrap starting.
I20260810 21:04:22.299474 18130 tablet_bootstrap.cc:492] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4: No bootstrap required, opened a new log
I20260810 21:04:22.299569 18130 ts_tablet_manager.cc:1397] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:04:22.299685 18131 tablet_bootstrap.cc:654] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:22.300034 18131 log.cc:824] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:22.300906 18131 tablet_bootstrap.cc:492] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8: No bootstrap required, opened a new log
I20260810 21:04:22.300980 18131 ts_tablet_manager.cc:1397] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:04:22.301421 18130 raft_consensus.cc:348] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } }
I20260810 21:04:22.301403 18129 raft_consensus.cc:348] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } }
I20260810 21:04:22.301563 18129 raft_consensus.cc:374] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:22.301585 18130 raft_consensus.cc:374] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:22.301596 18129 raft_consensus.cc:729] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f524af15c0b4dbe9095a24c5d203fc3, State: Initialized, Role: FOLLOWER
I20260810 21:04:22.301633 18130 raft_consensus.cc:729] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4cea1da76ae43f7be13b036f523f4b4, State: Initialized, Role: FOLLOWER
I20260810 21:04:22.301738 18129 consensus_queue.cc:260] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } }
I20260810 21:04:22.301762 18130 consensus_queue.cc:260] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } }
I20260810 21:04:22.302017 18129 ts_tablet_manager.cc:1428] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:04:22.302049 17854 heartbeater.cc:503] Master 127.15.37.62:41325 was elected leader, sending a full tablet report...
I20260810 21:04:22.302349 18130 ts_tablet_manager.cc:1428] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 21:04:22.302500 18092 heartbeater.cc:503] Master 127.15.37.62:41325 was elected leader, sending a full tablet report...
I20260810 21:04:22.303262 18131 raft_consensus.cc:348] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } }
I20260810 21:04:22.303427 18131 raft_consensus.cc:374] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:22.303476 18131 raft_consensus.cc:729] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21ad46b4fcb04063ba392425bdb720c8, State: Initialized, Role: FOLLOWER
I20260810 21:04:22.303587 18131 consensus_queue.cc:260] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } }
I20260810 21:04:22.303859 18131 ts_tablet_manager.cc:1428] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:04:22.303929 17647 heartbeater.cc:503] Master 127.15.37.62:41325 was elected leader, sending a full tablet report...
W20260810 21:04:22.325918 17855 tablet.cc:2369] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:04:22.387336 18140 raft_consensus.cc:482] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:22.387490 18140 raft_consensus.cc:504] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } }
I20260810 21:04:22.387828 18140 leader_election.cc:288] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f524af15c0b4dbe9095a24c5d203fc3 (127.15.37.2:33759), 21ad46b4fcb04063ba392425bdb720c8 (127.15.37.1:46329)
I20260810 21:04:22.392093 18126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.388170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:46431 (local address 127.15.37.1:46329)
0810 21:04:22.388236 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:22.388238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:22.388377 (+ 139us) server_negotiation.cc:407] Connection header received
0810 21:04:22.388409 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:22.388410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:22.388423 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:22.388534 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:22.388681 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.389448 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.391099 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.391678 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.391764 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.391777 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:22.391974 (+ 197us) server_negotiation.cc:299] Negotiation successful
0810 21:04:22.392018 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 21:04:22.392093 18128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.388180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:44145 (local address 127.15.37.2:33759)
0810 21:04:22.388243 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:22.388244 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:22.388255 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:04:22.388297 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:22.388298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:22.388323 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:22.388426 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:22.388682 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.389452 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.391099 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.391685 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.391764 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.391777 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:22.391974 (+ 197us) server_negotiation.cc:299] Negotiation successful
0810 21:04:22.392018 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 21:04:22.392110 17909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.388085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:33759 (local address 127.15.37.3:44145)
0810 21:04:22.388154 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:22.388168 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:22.388216 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:22.388451 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:22.388452 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:22.388454 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:22.388579 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.388581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.389553 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.389554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.390947 (+ 1393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.390952 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.391778 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.391779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.391876 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.391883 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 21:04:22.391944 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 21:04:22.391992 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":65}
I20260810 21:04:22.392117 18142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.388085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:46329 (local address 127.15.37.3:46431)
0810 21:04:22.388293 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:22.388302 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:22.388355 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:22.388533 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:22.388534 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:22.388535 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:22.388600 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.388602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.389553 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.389554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.390954 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.390956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.391779 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.391779 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.391876 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.391883 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 21:04:22.391944 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 21:04:22.391992 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":117,"thread_start_us":119,"threads_started":1}
I20260810 21:04:22.392612 17784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7dbfc9c89341c2b5a17bdc9e4319e1" candidate_uuid: "f4cea1da76ae43f7be13b036f523f4b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" is_pre_election: true
I20260810 21:04:22.392690 17579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7dbfc9c89341c2b5a17bdc9e4319e1" candidate_uuid: "f4cea1da76ae43f7be13b036f523f4b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21ad46b4fcb04063ba392425bdb720c8" is_pre_election: true
I20260810 21:04:22.392870 17579 raft_consensus.cc:2454] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4cea1da76ae43f7be13b036f523f4b4 in term 0.
I20260810 21:04:22.392871 17784 raft_consensus.cc:2454] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4cea1da76ae43f7be13b036f523f4b4 in term 0.
I20260810 21:04:22.393155 17902 leader_election.cc:302] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f524af15c0b4dbe9095a24c5d203fc3, f4cea1da76ae43f7be13b036f523f4b4; no voters:
I20260810 21:04:22.393369 18140 raft_consensus.cc:2781] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:22.393460 18140 raft_consensus.cc:482] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:22.393498 18140 raft_consensus.cc:3037] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:22.395114 18140 raft_consensus.cc:504] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } }
I20260810 21:04:22.395305 18140 leader_election.cc:288] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [CANDIDATE]: Term 1 election: Requested vote from peers 8f524af15c0b4dbe9095a24c5d203fc3 (127.15.37.2:33759), 21ad46b4fcb04063ba392425bdb720c8 (127.15.37.1:46329)
I20260810 21:04:22.395500 17579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7dbfc9c89341c2b5a17bdc9e4319e1" candidate_uuid: "f4cea1da76ae43f7be13b036f523f4b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21ad46b4fcb04063ba392425bdb720c8"
I20260810 21:04:22.395515 17784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df7dbfc9c89341c2b5a17bdc9e4319e1" candidate_uuid: "f4cea1da76ae43f7be13b036f523f4b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f524af15c0b4dbe9095a24c5d203fc3"
I20260810 21:04:22.395599 17784 raft_consensus.cc:3037] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:22.395606 17579 raft_consensus.cc:3037] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Advancing to term 1
W20260810 21:04:22.395992 17650 tablet.cc:2369] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:04:22.396664 17579 raft_consensus.cc:2454] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4cea1da76ae43f7be13b036f523f4b4 in term 1.
I20260810 21:04:22.396867 17899 leader_election.cc:302] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21ad46b4fcb04063ba392425bdb720c8, f4cea1da76ae43f7be13b036f523f4b4; no voters:
I20260810 21:04:22.396898 17784 raft_consensus.cc:2454] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4cea1da76ae43f7be13b036f523f4b4 in term 1.
I20260810 21:04:22.396975 18140 raft_consensus.cc:2781] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:22.397138 18140 raft_consensus.cc:686] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4cea1da76ae43f7be13b036f523f4b4, State: Running, Role: LEADER
I20260810 21:04:22.397238 18140 consensus_queue.cc:237] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } }
I20260810 21:04:22.398340 17320 catalog_manager.cc:5495] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4cea1da76ae43f7be13b036f523f4b4 (127.15.37.3). New cstate: current_term: 1 leader_uuid: "f4cea1da76ae43f7be13b036f523f4b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } health_report { overall_health: UNKNOWN } } }
I20260810 21:04:22.411558 18123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.408845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58298 (local address 127.15.37.3:33567)
0810 21:04:22.408912 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:22.408914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:22.408922 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:04:22.408958 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:22.408959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:22.408979 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:22.409044 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:22.409272 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.409754 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.410640 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.410851 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.410919 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.411193 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:22.411305 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:22.411381 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:22.411447 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 21:04:22.411471 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 21:04:22.413910 17579 raft_consensus.cc:1261] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8 [term 1 FOLLOWER]: Refusing update from remote peer f4cea1da76ae43f7be13b036f523f4b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:22.413910 17784 raft_consensus.cc:1261] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 1 FOLLOWER]: Refusing update from remote peer f4cea1da76ae43f7be13b036f523f4b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:22.414328 18140 consensus_queue.cc:1035] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:22.414564 18143 consensus_queue.cc:1035] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:22.417623 18146 mvcc.cc:205] Tried to move back new op lower bound from 7317077452444139520 to 7317077452380057600. Current Snapshot: MvccSnapshot[applied={T|T < 7317077452444139520}]
I20260810 21:04:22.418778 18149 mvcc.cc:205] Tried to move back new op lower bound from 7317077452444139520 to 7317077452380057600. Current Snapshot: MvccSnapshot[applied={T|T < 7317077452444139520}]
I20260810 21:04:22.422422 17321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:22.422582 17321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:22.423535 17321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2: Sending DeleteTablet for 3 replicas of tablet df7dbfc9c89341c2b5a17bdc9e4319e1
I20260810 21:04:22.423988 17548 tablet_service.cc:1514] Processing DeleteTablet for tablet df7dbfc9c89341c2b5a17bdc9e4319e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:22 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:37802
I20260810 21:04:22.424001 17763 tablet_service.cc:1514] Processing DeleteTablet for tablet df7dbfc9c89341c2b5a17bdc9e4319e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:22 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:58708
I20260810 21:04:22.424209 17986 tablet_service.cc:1514] Processing DeleteTablet for tablet df7dbfc9c89341c2b5a17bdc9e4319e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:22 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:58292
I20260810 21:04:22.424265 18158 tablet_replica.cc:330] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8: stopping tablet replica
I20260810 21:04:22.424238 17321 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58680:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:22.424373 17321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:22.424371 18158 raft_consensus.cc:2229] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:22.424492 18158 raft_consensus.cc:2258] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:22.424810 18162 tablet_replica.cc:330] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3: stopping tablet replica
I20260810 21:04:22.424810 18163 tablet_replica.cc:330] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4: stopping tablet replica
I20260810 21:04:22.425127 18163 raft_consensus.cc:2229] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:04:22.425092 18162 raft_consensus.cc:2229] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:22.425588 18158 ts_tablet_manager.cc:1905] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:22.425647 18162 raft_consensus.cc:2258] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:22.425812 18163 raft_consensus.cc:2258] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:22.425911 17548 tablet_service.cc:1467] Processing CreateTablet for tablet 4599044656b5484697856c0056d61bcc (DEFAULT_TABLE table=test-table [id=42813f5c563f436caa2adf1fdc84339f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:22.426066 17548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4599044656b5484697856c0056d61bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:22.426100 17763 tablet_service.cc:1467] Processing CreateTablet for tablet 4599044656b5484697856c0056d61bcc (DEFAULT_TABLE table=test-table [id=42813f5c563f436caa2adf1fdc84339f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:22.426203 17763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4599044656b5484697856c0056d61bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:22.427513 18129 tablet_bootstrap.cc:492] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3: Bootstrap starting.
I20260810 21:04:22.427570 17986 tablet_service.cc:1467] Processing CreateTablet for tablet 4599044656b5484697856c0056d61bcc (DEFAULT_TABLE table=test-table [id=42813f5c563f436caa2adf1fdc84339f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:22.427616 18131 tablet_bootstrap.cc:492] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8: Bootstrap starting.
I20260810 21:04:22.427692 17986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4599044656b5484697856c0056d61bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:22.428037 18131 tablet_bootstrap.cc:654] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:22.428041 18129 tablet_bootstrap.cc:654] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:22.428275 18158 ts_tablet_manager.cc:1918] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:22.428431 18158 log.cc:1196] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/wal/wals/df7dbfc9c89341c2b5a17bdc9e4319e1
I20260810 21:04:22.428874 18158 ts_tablet_manager.cc:1939] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 21ad46b4fcb04063ba392425bdb720c8: Deleting consensus metadata
I20260810 21:04:22.429056 18163 ts_tablet_manager.cc:1905] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:22.429495 17293 catalog_manager.cc:4841] TS 21ad46b4fcb04063ba392425bdb720c8 (127.15.37.1:46329): tablet df7dbfc9c89341c2b5a17bdc9e4319e1 (table test-table [id=87c0c13bd1e545b5ac61539bda0950fa]) successfully deleted
I20260810 21:04:22.430017 18130 tablet_bootstrap.cc:492] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4: Bootstrap starting.
I20260810 21:04:22.430604 18130 tablet_bootstrap.cc:654] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:22.431823 18163 ts_tablet_manager.cc:1918] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:22.431908 18163 log.cc:1196] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/df7dbfc9c89341c2b5a17bdc9e4319e1
I20260810 21:04:22.432168 18130 tablet_bootstrap.cc:492] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4: No bootstrap required, opened a new log
I20260810 21:04:22.432211 18163 ts_tablet_manager.cc:1939] T df7dbfc9c89341c2b5a17bdc9e4319e1 P f4cea1da76ae43f7be13b036f523f4b4: Deleting consensus metadata
I20260810 21:04:22.432226 18130 ts_tablet_manager.cc:1397] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 21:04:22.432716 18130 raft_consensus.cc:348] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.432819 18130 raft_consensus.cc:374] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:22.432798 17299 catalog_manager.cc:4841] TS f4cea1da76ae43f7be13b036f523f4b4 (127.15.37.3:33567): tablet df7dbfc9c89341c2b5a17bdc9e4319e1 (table test-table [id=87c0c13bd1e545b5ac61539bda0950fa]) successfully deleted
I20260810 21:04:22.432852 18130 raft_consensus.cc:729] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4cea1da76ae43f7be13b036f523f4b4, State: Initialized, Role: FOLLOWER
I20260810 21:04:22.432896 18130 consensus_queue.cc:260] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.432984 18162 ts_tablet_manager.cc:1905] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:22.432997 18130 ts_tablet_manager.cc:1428] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:22.435133 18162 ts_tablet_manager.cc:1918] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:22.435248 18162 log.cc:1196] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/df7dbfc9c89341c2b5a17bdc9e4319e1
I20260810 21:04:22.435568 18162 ts_tablet_manager.cc:1939] T df7dbfc9c89341c2b5a17bdc9e4319e1 P 8f524af15c0b4dbe9095a24c5d203fc3: Deleting consensus metadata
I20260810 21:04:22.436101 17299 catalog_manager.cc:4841] TS 8f524af15c0b4dbe9095a24c5d203fc3 (127.15.37.2:33759): tablet df7dbfc9c89341c2b5a17bdc9e4319e1 (table test-table [id=87c0c13bd1e545b5ac61539bda0950fa]) successfully deleted
I20260810 21:04:22.436455 18131 tablet_bootstrap.cc:492] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8: No bootstrap required, opened a new log
I20260810 21:04:22.436570 18131 ts_tablet_manager.cc:1397] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20260810 21:04:22.436985 18131 raft_consensus.cc:348] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.437105 18131 raft_consensus.cc:374] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:22.437135 18131 raft_consensus.cc:729] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21ad46b4fcb04063ba392425bdb720c8, State: Initialized, Role: FOLLOWER
I20260810 21:04:22.437183 18131 consensus_queue.cc:260] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.437356 18131 ts_tablet_manager.cc:1428] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:22.437723 18129 tablet_bootstrap.cc:492] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3: No bootstrap required, opened a new log
I20260810 21:04:22.437796 18129 ts_tablet_manager.cc:1397] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20260810 21:04:22.438282 18129 raft_consensus.cc:348] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.438390 18129 raft_consensus.cc:374] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:22.438414 18129 raft_consensus.cc:729] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f524af15c0b4dbe9095a24c5d203fc3, State: Initialized, Role: FOLLOWER
I20260810 21:04:22.438464 18129 consensus_queue.cc:260] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.438565 18129 ts_tablet_manager.cc:1428] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260810 21:04:22.501987 18093 tablet.cc:2369] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:04:22.698038 18143 raft_consensus.cc:482] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:22.698189 18143 raft_consensus.cc:504] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.698469 18143 leader_election.cc:288] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21ad46b4fcb04063ba392425bdb720c8 (127.15.37.1:46329), 8f524af15c0b4dbe9095a24c5d203fc3 (127.15.37.2:33759)
I20260810 21:04:22.698779 17579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4599044656b5484697856c0056d61bcc" candidate_uuid: "f4cea1da76ae43f7be13b036f523f4b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21ad46b4fcb04063ba392425bdb720c8" is_pre_election: true
I20260810 21:04:22.698783 17784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4599044656b5484697856c0056d61bcc" candidate_uuid: "f4cea1da76ae43f7be13b036f523f4b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" is_pre_election: true
I20260810 21:04:22.698904 17579 raft_consensus.cc:2454] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4cea1da76ae43f7be13b036f523f4b4 in term 0.
I20260810 21:04:22.698901 17784 raft_consensus.cc:2454] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4cea1da76ae43f7be13b036f523f4b4 in term 0.
I20260810 21:04:22.699077 17899 leader_election.cc:302] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21ad46b4fcb04063ba392425bdb720c8, f4cea1da76ae43f7be13b036f523f4b4; no voters:
I20260810 21:04:22.699188 18143 raft_consensus.cc:2781] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:22.699237 18143 raft_consensus.cc:482] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:22.699270 18143 raft_consensus.cc:3037] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:22.700117 18143 raft_consensus.cc:504] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.700292 18143 leader_election.cc:288] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [CANDIDATE]: Term 1 election: Requested vote from peers 21ad46b4fcb04063ba392425bdb720c8 (127.15.37.1:46329), 8f524af15c0b4dbe9095a24c5d203fc3 (127.15.37.2:33759)
I20260810 21:04:22.700523 17784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4599044656b5484697856c0056d61bcc" candidate_uuid: "f4cea1da76ae43f7be13b036f523f4b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f524af15c0b4dbe9095a24c5d203fc3"
I20260810 21:04:22.700523 17579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4599044656b5484697856c0056d61bcc" candidate_uuid: "f4cea1da76ae43f7be13b036f523f4b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21ad46b4fcb04063ba392425bdb720c8"
I20260810 21:04:22.700627 17784 raft_consensus.cc:3037] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:22.700627 17579 raft_consensus.cc:3037] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:22.701656 17784 raft_consensus.cc:2454] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4cea1da76ae43f7be13b036f523f4b4 in term 1.
I20260810 21:04:22.701767 17579 raft_consensus.cc:2454] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4cea1da76ae43f7be13b036f523f4b4 in term 1.
I20260810 21:04:22.701910 17902 leader_election.cc:302] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f524af15c0b4dbe9095a24c5d203fc3, f4cea1da76ae43f7be13b036f523f4b4; no voters:
I20260810 21:04:22.702030 18143 raft_consensus.cc:2781] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:22.702102 18143 raft_consensus.cc:686] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4cea1da76ae43f7be13b036f523f4b4, State: Running, Role: LEADER
I20260810 21:04:22.702165 18143 consensus_queue.cc:237] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.702953 17321 catalog_manager.cc:5495] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4cea1da76ae43f7be13b036f523f4b4 (127.15.37.3). New cstate: current_term: 1 leader_uuid: "f4cea1da76ae43f7be13b036f523f4b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } health_report { overall_health: HEALTHY } } }
Aug 10 21:04:22 dist-test-slave-jq4t krb5kdc[17241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395861, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:22.741873 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.733679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58684 (local address 127.15.37.62:41325)
0810 21:04:22.733751 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:22.733753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:22.733959 (+ 206us) server_negotiation.cc:407] Connection header received
0810 21:04:22.734060 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:22.734061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:22.734073 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:22.734143 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:22.734771 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.735288 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.736087 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.736279 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.736354 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.738997 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:22.738999 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:22.739000 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:22.739007 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:22.740576 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:22.740988 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:22.740989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:22.740990 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:22.741051 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:22.741252 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:22.741253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:22.741254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:22.741383 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:22.741463 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:22.741637 (+ 174us) server_negotiation.cc:299] Negotiation successful
0810 21:04:22.741730 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 21:04:22.742027 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:22.733663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:41325 (local address 127.0.0.1:58684)
0810 21:04:22.733877 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:22.733886 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:22.733982 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:22.734165 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:22.734166 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:22.734625 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:22.734682 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.734685 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.735381 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.735382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.735979 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:22.735981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:22.736369 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:22.736370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:22.736426 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:22.737164 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:22.737170 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:22.738893 (+ 1723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:22.740672 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:22.740682 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:22.740684 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:22.740908 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:22.741127 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:22.741127 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:22.741128 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:22.741190 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:22.741452 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:22.741462 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:22.741511 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 21:04:22.741612 (+ 101us) client_negotiation.cc:240] Negotiation successful
0810 21:04:22.741785 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":64,"thread_start_us":137,"threads_started":1}
I20260810 21:04:22.744628 17321 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:58684:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 21:04:22.744907 17321 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:22.746562 17548 tablet_service.cc:1467] Processing CreateTablet for tablet beacead30c064149aecdbe404132ba87 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=575277ac4b0848bc90eaacce2483dde5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 21:04:22.746510 17763 tablet_service.cc:1467] Processing CreateTablet for tablet beacead30c064149aecdbe404132ba87 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=575277ac4b0848bc90eaacce2483dde5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 21:04:22.746518 17986 tablet_service.cc:1467] Processing CreateTablet for tablet beacead30c064149aecdbe404132ba87 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=575277ac4b0848bc90eaacce2483dde5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 21:04:22.746780 17986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beacead30c064149aecdbe404132ba87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:22.746812 17763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beacead30c064149aecdbe404132ba87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:22.746869 17548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beacead30c064149aecdbe404132ba87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:22.748688 18129 tablet_bootstrap.cc:492] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3: Bootstrap starting.
I20260810 21:04:22.748802 18130 tablet_bootstrap.cc:492] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4: Bootstrap starting.
I20260810 21:04:22.748943 18131 tablet_bootstrap.cc:492] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8: Bootstrap starting.
I20260810 21:04:22.749447 18130 tablet_bootstrap.cc:654] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:22.749568 18129 tablet_bootstrap.cc:654] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:22.749861 18131 tablet_bootstrap.cc:654] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:22.750460 18130 tablet_bootstrap.cc:492] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4: No bootstrap required, opened a new log
I20260810 21:04:22.750512 18130 ts_tablet_manager.cc:1397] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:04:22.750577 18129 tablet_bootstrap.cc:492] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3: No bootstrap required, opened a new log
I20260810 21:04:22.750626 18129 ts_tablet_manager.cc:1397] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:04:22.750679 18130 raft_consensus.cc:348] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.750765 18130 raft_consensus.cc:374] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:22.750782 18130 raft_consensus.cc:729] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4cea1da76ae43f7be13b036f523f4b4, State: Initialized, Role: FOLLOWER
I20260810 21:04:22.750854 18130 consensus_queue.cc:260] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.751036 18131 tablet_bootstrap.cc:492] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8: No bootstrap required, opened a new log
I20260810 21:04:22.751001 18129 raft_consensus.cc:348] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.751081 18131 ts_tablet_manager.cc:1397] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 21:04:22.751083 18129 raft_consensus.cc:374] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:22.751106 18129 raft_consensus.cc:729] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f524af15c0b4dbe9095a24c5d203fc3, State: Initialized, Role: FOLLOWER
I20260810 21:04:22.751152 18129 consensus_queue.cc:260] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.751271 18130 ts_tablet_manager.cc:1428] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:22.751312 18129 ts_tablet_manager.cc:1428] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 21:04:22.751387 18131 raft_consensus.cc:348] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.751461 18131 raft_consensus.cc:374] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:22.751488 18131 raft_consensus.cc:729] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21ad46b4fcb04063ba392425bdb720c8, State: Initialized, Role: FOLLOWER
I20260810 21:04:22.751535 18131 consensus_queue.cc:260] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:22.751319 18137 tablet_replica.cc:439] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } }
I20260810 21:04:22.751628 18131 ts_tablet_manager.cc:1428] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260810 21:04:22.751643 18137 tablet_replica.cc:442] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:22.751724 18143 tablet_replica.cc:439] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } }
I20260810 21:04:22.751804 18143 tablet_replica.cc:442] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:22.751868 18141 tablet_replica.cc:439] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } }
I20260810 21:04:22.751977 18141 tablet_replica.cc:442] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:23.080006 18143 raft_consensus.cc:482] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:23.080117 18143 raft_consensus.cc:504] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:23.080297 18143 leader_election.cc:288] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21ad46b4fcb04063ba392425bdb720c8 (127.15.37.1:46329), 8f524af15c0b4dbe9095a24c5d203fc3 (127.15.37.2:33759)
I20260810 21:04:23.080555 18137 raft_consensus.cc:482] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:23.080633 17784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beacead30c064149aecdbe404132ba87" candidate_uuid: "f4cea1da76ae43f7be13b036f523f4b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" is_pre_election: true
I20260810 21:04:23.080659 17579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beacead30c064149aecdbe404132ba87" candidate_uuid: "f4cea1da76ae43f7be13b036f523f4b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21ad46b4fcb04063ba392425bdb720c8" is_pre_election: true
I20260810 21:04:23.080657 18137 raft_consensus.cc:504] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:23.080767 17579 raft_consensus.cc:2454] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4cea1da76ae43f7be13b036f523f4b4 in term 0.
I20260810 21:04:23.080875 17784 raft_consensus.cc:2454] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4cea1da76ae43f7be13b036f523f4b4 in term 0.
I20260810 21:04:23.080946 17899 leader_election.cc:302] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21ad46b4fcb04063ba392425bdb720c8, f4cea1da76ae43f7be13b036f523f4b4; no voters:
I20260810 21:04:23.081080 18143 raft_consensus.cc:2781] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:23.081140 18143 raft_consensus.cc:482] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:23.081125 18137 leader_election.cc:288] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21ad46b4fcb04063ba392425bdb720c8 (127.15.37.1:46329), f4cea1da76ae43f7be13b036f523f4b4 (127.15.37.3:33567)
I20260810 21:04:23.081164 18143 raft_consensus.cc:3037] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:23.082316 18143 raft_consensus.cc:504] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:23.082471 18143 leader_election.cc:288] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [CANDIDATE]: Term 1 election: Requested vote from peers 21ad46b4fcb04063ba392425bdb720c8 (127.15.37.1:46329), 8f524af15c0b4dbe9095a24c5d203fc3 (127.15.37.2:33759)
I20260810 21:04:23.082736 17784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beacead30c064149aecdbe404132ba87" candidate_uuid: "f4cea1da76ae43f7be13b036f523f4b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f524af15c0b4dbe9095a24c5d203fc3"
I20260810 21:04:23.082739 17579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beacead30c064149aecdbe404132ba87" candidate_uuid: "f4cea1da76ae43f7be13b036f523f4b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21ad46b4fcb04063ba392425bdb720c8"
I20260810 21:04:23.082816 17784 raft_consensus.cc:3037] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:23.082816 17579 raft_consensus.cc:3037] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:23.083623 17784 raft_consensus.cc:2454] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4cea1da76ae43f7be13b036f523f4b4 in term 1.
I20260810 21:04:23.083623 17579 raft_consensus.cc:2454] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4cea1da76ae43f7be13b036f523f4b4 in term 1.
I20260810 21:04:23.083804 17899 leader_election.cc:302] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21ad46b4fcb04063ba392425bdb720c8, f4cea1da76ae43f7be13b036f523f4b4; no voters:
I20260810 21:04:23.083974 18143 raft_consensus.cc:2781] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:23.084030 18143 raft_consensus.cc:686] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [term 1 LEADER]: Becoming Leader. State: Replica: f4cea1da76ae43f7be13b036f523f4b4, State: Running, Role: LEADER
I20260810 21:04:23.084088 18143 consensus_queue.cc:237] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } }
I20260810 21:04:23.084362 18143 tablet_replica.cc:439] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4: TxnStatusTablet state changed. Reason: New leader f4cea1da76ae43f7be13b036f523f4b4. Latest consensus state: current_term: 1 leader_uuid: "f4cea1da76ae43f7be13b036f523f4b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } }
I20260810 21:04:23.084441 18143 tablet_replica.cc:442] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4: This TxnStatusTablet replica's current role is: LEADER
I20260810 21:04:23.084808 18194 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 21:04:23.084967 18194 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 21:04:23.084964 17321 catalog_manager.cc:5495] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4cea1da76ae43f7be13b036f523f4b4 (127.15.37.3). New cstate: current_term: 1 leader_uuid: "f4cea1da76ae43f7be13b036f523f4b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } health_report { overall_health: HEALTHY } } }
I20260810 21:04:23.085682 18185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:23.081274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:46329 (local address 127.15.37.2:59507)
0810 21:04:23.081759 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:23.081768 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:23.081811 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:23.081998 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:23.081999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:23.082002 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:23.082085 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:23.082087 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.083089 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.083090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:23.084558 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:23.084561 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.085395 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.085396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:23.085473 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:23.085475 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 21:04:23.085529 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 21:04:23.085592 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"mutex_wait_us":43,"thread_start_us":65,"threads_started":1}
I20260810 21:04:23.085744 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:23.081477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:52679 (local address 127.15.37.3:33567)
0810 21:04:23.081591 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:23.081597 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:23.081658 (+ 61us) server_negotiation.cc:407] Connection header received
0810 21:04:23.081738 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:23.081739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:23.081749 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:23.081895 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:23.082206 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.083007 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.084669 (+ 1662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.085267 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.085339 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:23.085352 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:23.085629 (+ 277us) server_negotiation.cc:299] Negotiation successful
0810 21:04:23.085671 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":46,"threads_started":1}
I20260810 21:04:23.085983 18184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:23.081274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:33567 (local address 127.15.37.2:52679)
0810 21:04:23.081591 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:23.081605 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:23.081675 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:23.081958 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:23.081959 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:23.081962 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:23.082093 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:23.082095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.083100 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.083101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:23.084558 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:23.084561 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.085394 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.085395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:23.085469 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:23.085485 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 21:04:23.085532 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 21:04:23.085592 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":21,"thread_start_us":65,"threads_started":1}
I20260810 21:04:23.085992 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:23.081368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:59507 (local address 127.15.37.1:46329)
0810 21:04:23.081506 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:23.081508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:23.081832 (+ 324us) server_negotiation.cc:407] Connection header received
0810 21:04:23.081863 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:23.081864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:23.081879 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:23.081949 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:23.082182 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.082986 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.084667 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.085275 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.085339 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:23.085354 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:23.085848 (+ 494us) server_negotiation.cc:299] Negotiation successful
0810 21:04:23.085901 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":68,"threads_started":1}
I20260810 21:04:23.086303 17579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beacead30c064149aecdbe404132ba87" candidate_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21ad46b4fcb04063ba392425bdb720c8" is_pre_election: true
I20260810 21:04:23.086309 18015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beacead30c064149aecdbe404132ba87" candidate_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4cea1da76ae43f7be13b036f523f4b4" is_pre_election: true
I20260810 21:04:23.086412 17579 raft_consensus.cc:2379] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8f524af15c0b4dbe9095a24c5d203fc3 in current term 1: Already voted for candidate f4cea1da76ae43f7be13b036f523f4b4 in this term.
I20260810 21:04:23.086742 17688 leader_election.cc:302] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f524af15c0b4dbe9095a24c5d203fc3; no voters: 21ad46b4fcb04063ba392425bdb720c8, f4cea1da76ae43f7be13b036f523f4b4
I20260810 21:04:23.086922 18137 raft_consensus.cc:2726] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 21:04:23.110030 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:23.107279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:33567 (local address 127.0.0.1:58306)
0810 21:04:23.107380 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:23.107394 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:23.107460 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:23.107648 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:23.107649 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:23.107651 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 21:04:23.107712 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:23.107715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.108401 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.108402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:23.109125 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:23.109128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.109525 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.109526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:23.109588 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:23.109620 (+ 32us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 21:04:23.109841 (+ 221us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 21:04:23.109854 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 21:04:23.109901 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 21:04:23.109958 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 21:04:23.110023 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:23.107391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58306 (local address 127.15.37.3:33567)
0810 21:04:23.107443 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:23.107446 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:23.107456 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:04:23.107542 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:23.107543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:23.107562 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:23.107619 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:23.107794 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.108300 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.109230 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.109442 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.109525 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:23.109713 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:23.109761 (+ 48us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:23.109825 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:23.109905 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 21:04:23.109932 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 21:04:23.111639 17784 raft_consensus.cc:1261] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3 [term 1 FOLLOWER]: Refusing update from remote peer f4cea1da76ae43f7be13b036f523f4b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:23.111702 17579 raft_consensus.cc:1261] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8 [term 1 FOLLOWER]: Refusing update from remote peer f4cea1da76ae43f7be13b036f523f4b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:23.111974 18143 consensus_queue.cc:1035] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:23.112119 18140 consensus_queue.cc:1035] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:23.112581 18137 tablet_replica.cc:439] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3: TxnStatusTablet state changed. Reason: New leader f4cea1da76ae43f7be13b036f523f4b4. Latest consensus state: current_term: 1 leader_uuid: "f4cea1da76ae43f7be13b036f523f4b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } }
I20260810 21:04:23.112677 18137 tablet_replica.cc:442] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:23.112871 18141 tablet_replica.cc:439] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8: TxnStatusTablet state changed. Reason: New leader f4cea1da76ae43f7be13b036f523f4b4. Latest consensus state: current_term: 1 leader_uuid: "f4cea1da76ae43f7be13b036f523f4b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } }
I20260810 21:04:23.112982 18141 tablet_replica.cc:442] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:23.113787 18140 tablet_replica.cc:439] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f4cea1da76ae43f7be13b036f523f4b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } }
I20260810 21:04:23.113915 18140 tablet_replica.cc:442] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4: This TxnStatusTablet replica's current role is: LEADER
I20260810 21:04:23.114763 18141 tablet_replica.cc:439] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f4cea1da76ae43f7be13b036f523f4b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } }
I20260810 21:04:23.114881 18141 tablet_replica.cc:442] T beacead30c064149aecdbe404132ba87 P 21ad46b4fcb04063ba392425bdb720c8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:23.116062 18140 tablet_replica.cc:439] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f4cea1da76ae43f7be13b036f523f4b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } }
I20260810 21:04:23.116160 18140 tablet_replica.cc:442] T beacead30c064149aecdbe404132ba87 P f4cea1da76ae43f7be13b036f523f4b4: This TxnStatusTablet replica's current role is: LEADER
I20260810 21:04:23.116595 18200 mvcc.cc:205] Tried to move back new op lower bound from 7317077455303057408 to 7317077455192698880. Current Snapshot: MvccSnapshot[applied={T|T < 7317077455303057408}]
I20260810 21:04:23.116932 18137 tablet_replica.cc:439] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f4cea1da76ae43f7be13b036f523f4b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 } } peers { permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 } } peers { permanent_uuid: "f4cea1da76ae43f7be13b036f523f4b4" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33567 } } }
I20260810 21:04:23.117019 18137 tablet_replica.cc:442] T beacead30c064149aecdbe404132ba87 P 8f524af15c0b4dbe9095a24c5d203fc3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:23.122277 18188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:23.119342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:47835 (local address 127.15.37.3:33567)
0810 21:04:23.119396 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:23.119399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:23.119650 (+ 251us) server_negotiation.cc:407] Connection header received
0810 21:04:23.119711 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:23.119712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:23.119720 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:23.119767 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:23.119880 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.120361 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.121548 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.121733 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.121794 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:23.122032 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:23.122060 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:23.122100 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:23.122182 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 21:04:23.122201 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 21:04:23.122362 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:23.119309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:33567 (local address 127.15.37.3:47835)
0810 21:04:23.119563 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:23.119577 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:23.119652 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:23.119771 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:23.119772 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:23.119773 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 21:04:23.119827 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:23.119829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.120449 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.120450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:23.121449 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:23.121452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.121814 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.121815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:23.121923 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:23.121944 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 21:04:23.122122 (+ 178us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 21:04:23.122125 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:04:23.122181 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 21:04:23.122229 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":96,"threads_started":1}
I20260810 21:04:23.124956 17579 raft_consensus.cc:1261] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8 [term 1 FOLLOWER]: Refusing update from remote peer f4cea1da76ae43f7be13b036f523f4b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:23.124985 17784 raft_consensus.cc:1261] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3 [term 1 FOLLOWER]: Refusing update from remote peer f4cea1da76ae43f7be13b036f523f4b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:23.125187 18140 consensus_queue.cc:1035] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f524af15c0b4dbe9095a24c5d203fc3" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:23.125283 18143 consensus_queue.cc:1035] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21ad46b4fcb04063ba392425bdb720c8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:23.139081 17321 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:23.139207 17321 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:23.139860 17321 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0d40c1d139594f1dbd158ed47bd79be2: Sending DeleteTablet for 3 replicas of tablet 4599044656b5484697856c0056d61bcc
I20260810 21:04:23.140178 17548 tablet_service.cc:1514] Processing DeleteTablet for tablet 4599044656b5484697856c0056d61bcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:23 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:37802
I20260810 21:04:23.140178 17763 tablet_service.cc:1514] Processing DeleteTablet for tablet 4599044656b5484697856c0056d61bcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:23 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:58708
I20260810 21:04:23.140591 18226 tablet_replica.cc:330] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3: stopping tablet replica
I20260810 21:04:23.140663 18226 raft_consensus.cc:2229] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:23.140765 18226 raft_consensus.cc:2258] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:23.141049 17986 tablet_service.cc:1514] Processing DeleteTablet for tablet 4599044656b5484697856c0056d61bcc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:23 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:58292
I20260810 21:04:23.141324 18226 ts_tablet_manager.cc:1905] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:23.141400 18230 tablet_replica.cc:330] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4: stopping tablet replica
I20260810 21:04:23.141462 18230 raft_consensus.cc:2229] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:04:23.141526 18230 raft_consensus.cc:2258] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:23.141779 18230 ts_tablet_manager.cc:1905] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:23.143422 18226 ts_tablet_manager.cc:1918] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:23.143492 18226 log.cc:1196] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/4599044656b5484697856c0056d61bcc
I20260810 21:04:23.143631 18230 ts_tablet_manager.cc:1918] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:23.143700 18230 log.cc:1196] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/4599044656b5484697856c0056d61bcc
I20260810 21:04:23.143774 18226 ts_tablet_manager.cc:1939] T 4599044656b5484697856c0056d61bcc P 8f524af15c0b4dbe9095a24c5d203fc3: Deleting consensus metadata
I20260810 21:04:23.143923 18230 ts_tablet_manager.cc:1939] T 4599044656b5484697856c0056d61bcc P f4cea1da76ae43f7be13b036f523f4b4: Deleting consensus metadata
I20260810 21:04:23.144181 17299 catalog_manager.cc:4841] TS 8f524af15c0b4dbe9095a24c5d203fc3 (127.15.37.2:33759): tablet 4599044656b5484697856c0056d61bcc (table test-table [id=42813f5c563f436caa2adf1fdc84339f]) successfully deleted
I20260810 21:04:23.144284 17299 catalog_manager.cc:4841] TS f4cea1da76ae43f7be13b036f523f4b4 (127.15.37.3:33567): tablet 4599044656b5484697856c0056d61bcc (table test-table [id=42813f5c563f436caa2adf1fdc84339f]) successfully deleted
I20260810 21:04:23.147428 18227 tablet_replica.cc:330] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8: stopping tablet replica
I20260810 21:04:23.147511 18227 raft_consensus.cc:2229] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:23.147567 18227 raft_consensus.cc:2258] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:23.147866 18227 ts_tablet_manager.cc:1905] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 10 21:04:23 dist-test-slave-jq4t krb5kdc[17241](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395862, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.37.1@KRBTEST.COM
I20260810 21:04:23.149900 18227 ts_tablet_manager.cc:1918] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:23.150319 18227 log.cc:1196] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786395855004795-15508-0/minicluster-data/ts-0/wal/wals/4599044656b5484697856c0056d61bcc
I20260810 21:04:23.150583 18227 ts_tablet_manager.cc:1939] T 4599044656b5484697856c0056d61bcc P 21ad46b4fcb04063ba392425bdb720c8: Deleting consensus metadata
I20260810 21:04:23.151332 17293 catalog_manager.cc:4841] TS 21ad46b4fcb04063ba392425bdb720c8 (127.15.37.1:46329): tablet 4599044656b5484697856c0056d61bcc (table test-table [id=42813f5c563f436caa2adf1fdc84339f]) successfully deleted
I20260810 21:04:23.153556 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:23.141132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37816 (local address 127.15.37.1:46329)
0810 21:04:23.141179 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:23.141181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:23.143268 (+ 2087us) server_negotiation.cc:407] Connection header received
0810 21:04:23.143355 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:23.143357 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:23.143374 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:23.143438 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:23.144844 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.145339 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.146093 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.146353 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.146432 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:23.149563 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:23.149573 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:23.149573 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:23.149582 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:23.151843 (+ 2261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:23.152345 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:23.152350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:23.152350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:23.152623 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:23.152889 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:23.152890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:23.152890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:23.153056 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:23.153179 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:23.153317 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 21:04:23.153480 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 21:04:23.153923 17637 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37816
I20260810 21:04:23.161648 17406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:23.155080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58692 (local address 127.15.37.62:41325)
0810 21:04:23.155153 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:23.155155 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:23.155304 (+ 149us) server_negotiation.cc:407] Connection header received
0810 21:04:23.155389 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:23.155390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:23.155401 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:23.155447 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:23.155956 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.156586 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.157304 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:23.157526 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:23.157606 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:23.158895 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:23.158897 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:23.158897 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:23.158905 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:23.160431 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:23.160918 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:23.160919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:23.160919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:23.160977 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:23.161189 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:23.161190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:23.161190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:23.161303 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:23.161382 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:23.161517 (+ 135us) server_negotiation.cc:299] Negotiation successful
0810 21:04:23.161580 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260810 21:04:23.161978 17321 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58692
I20260810 21:04:23.162550 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 17445
I20260810 21:04:23.179289 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 17658
I20260810 21:04:23.192272 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 17870
I20260810 21:04:23.202490 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 17269
2026-08-10T21:04:23Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3127 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:04:23 dist-test-slave-jq4t krb5kdc[18243](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:04:23 dist-test-slave-jq4t krb5kdc[18243](info): set up 2 sockets
Aug 10 21:04:23 dist-test-slave-jq4t krb5kdc[18243](info): commencing operation
krb5kdc: starting...
W20260810 21:04:24.472069 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.241s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:04:24 dist-test-slave-jq4t krb5kdc[18243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:04:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:04:24.607527 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:38457
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:37527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:38457
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:24.695689 18263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:24.695971 18263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:24.696013 18263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:24.697307 18263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:24.697388 18263 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 21:04:24.697412 18263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:24.697435 18263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:24.697464 18263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:24.697489 18263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:24.699090 18263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:38457
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:38457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:24.699380 18263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:24.699641 18263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:24.704845 18275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:24.704838 18277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:24.704843 18280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:24.705207 18263 server_base.cc:1034] running on GCE node
I20260810 21:04:24.705476 18263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:24.705809 18263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:24.707018 18263 hybrid_clock.cc:648] HybridClock initialized: now 1786395864707002 us; error 32 us; skew 500 ppm
Aug 10 21:04:24 dist-test-slave-jq4t krb5kdc[18243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395864, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:24.709928 18263 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:04:24.710450 18263 webserver.cc:460] Webserver started at http://127.15.37.62:39781/ using document root <none> and password file <none>
I20260810 21:04:24.710695 18263 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:24.710740 18263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:24.710850 18263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:24.711967 18263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "976c41c2ae174cd7a135110aea919785"
format_stamp: "Formatted at 2026-08-10 21:04:24 on dist-test-slave-jq4t"
server_key: "c4e3152189347248709860228a4cc268"
server_key_iv: "cfa8b8e2032928382d13339ff7c6a5c8"
server_key_version: "encryptionkey@0"
I20260810 21:04:24.712308 18263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "976c41c2ae174cd7a135110aea919785"
format_stamp: "Formatted at 2026-08-10 21:04:24 on dist-test-slave-jq4t"
server_key: "c4e3152189347248709860228a4cc268"
server_key_iv: "cfa8b8e2032928382d13339ff7c6a5c8"
server_key_version: "encryptionkey@0"
I20260810 21:04:24.713766 18263 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:24.714598 18290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:24.714792 18263 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:24.714910 18263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "976c41c2ae174cd7a135110aea919785"
format_stamp: "Formatted at 2026-08-10 21:04:24 on dist-test-slave-jq4t"
server_key: "c4e3152189347248709860228a4cc268"
server_key_iv: "cfa8b8e2032928382d13339ff7c6a5c8"
server_key_version: "encryptionkey@0"
I20260810 21:04:24.714993 18263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:24.737522 18263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:24.740222 18263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:24.740417 18263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:24.747064 18263 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:38457
I20260810 21:04:24.747116 18385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:38457 every 8 connection(s)
I20260810 21:04:24.747581 18263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:24.748373 18386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:24.751082 18386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785: Bootstrap starting.
I20260810 21:04:24.751724 18386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:24.751981 18386 log.cc:824] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:24.752836 18386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785: No bootstrap required, opened a new log
I20260810 21:04:24.754233 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 18263
I20260810 21:04:24.754340 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:24.754511 15508 external_mini_cluster.cc:1428] Setting key eec93f0ba31e58625ab24a08a066e842
I20260810 21:04:24.755690 18386 raft_consensus.cc:348] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "976c41c2ae174cd7a135110aea919785" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38457 } }
I20260810 21:04:24.755883 18386 raft_consensus.cc:374] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:24.755931 18386 raft_consensus.cc:729] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 976c41c2ae174cd7a135110aea919785, State: Initialized, Role: FOLLOWER
I20260810 21:04:24.756093 18386 consensus_queue.cc:260] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "976c41c2ae174cd7a135110aea919785" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38457 } }
I20260810 21:04:24.756197 18386 raft_consensus.cc:388] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:24.756245 18386 raft_consensus.cc:482] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:24.756323 18386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:24.757076 18386 raft_consensus.cc:504] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "976c41c2ae174cd7a135110aea919785" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38457 } }
I20260810 21:04:24.757220 18386 leader_election.cc:302] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 976c41c2ae174cd7a135110aea919785; no voters:
I20260810 21:04:24.757452 18386 leader_election.cc:288] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:24.757478 18394 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:24.757612 18394 raft_consensus.cc:686] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [term 1 LEADER]: Becoming Leader. State: Replica: 976c41c2ae174cd7a135110aea919785, State: Running, Role: LEADER
I20260810 21:04:24.757709 18394 consensus_queue.cc:237] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "976c41c2ae174cd7a135110aea919785" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38457 } }
I20260810 21:04:24.757800 18386 sys_catalog.cc:564] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:24.758097 18399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "976c41c2ae174cd7a135110aea919785" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "976c41c2ae174cd7a135110aea919785" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38457 } } }
I20260810 21:04:24.758189 18399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:24.758085 18394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 976c41c2ae174cd7a135110aea919785. Latest consensus state: current_term: 1 leader_uuid: "976c41c2ae174cd7a135110aea919785" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "976c41c2ae174cd7a135110aea919785" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38457 } } }
I20260810 21:04:24.758378 18394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:24.758896 18403 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:24.759482 18403 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:24.761932 18403 catalog_manager.cc:1347] Generated new cluster ID: 05b50885e76247be9b4451e8d8d46b3b
I20260810 21:04:24.762100 18403 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:04:24 dist-test-slave-jq4t krb5kdc[18243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:24.767447 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:24.755244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55592 (local address 127.15.37.62:38457)
0810 21:04:24.755485 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:24.755495 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:24.755526 (+ 31us) server_negotiation.cc:407] Connection header received
0810 21:04:24.755644 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:24.755651 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:24.755699 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:24.755873 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:24.756737 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:24.758042 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:24.759213 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:24.759837 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:24.759963 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:24.762956 (+ 2993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:24.762961 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:24.762961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:24.762976 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:24.765222 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:24.765665 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:24.765669 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:24.765670 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:24.765821 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:24.766051 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:24.766052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:24.766053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:24.766432 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:24.766622 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:24.766701 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 21:04:24.766866 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":107,"threads_started":1}
I20260810 21:04:24.772502 18403 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:24.773138 18403 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:24.777411 18403 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785: Generated new TSK 0
I20260810 21:04:24.777642 18403 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:04:24.811933 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38457
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:37527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:24.902221 18428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:24.902429 18428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:24.902457 18428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:24.903673 18428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:24.903716 18428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:24.903736 18428 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 21:04:24.903774 18428 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 21:04:24.903810 18428 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:04:24.905424 18428 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.37.62:38457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:24.905704 18428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:24.905961 18428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:24.911590 18436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:24.911707 18438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:24.911633 18440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:24.912107 18428 server_base.cc:1034] running on GCE node
I20260810 21:04:24.912348 18428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:24.912686 18428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:24.913854 18428 hybrid_clock.cc:648] HybridClock initialized: now 1786395864913836 us; error 45 us; skew 500 ppm
Aug 10 21:04:24 dist-test-slave-jq4t krb5kdc[18243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395864, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:24.916697 18428 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:04:24.917287 18428 webserver.cc:460] Webserver started at http://127.15.37.1:35517/ using document root <none> and password file <none>
I20260810 21:04:24.917538 18428 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:24.917613 18428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:24.917768 18428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:24.918947 18428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "0586dd2d53ad46219281bda1ea2ba060"
format_stamp: "Formatted at 2026-08-10 21:04:24 on dist-test-slave-jq4t"
server_key: "a998d3bae5c09dcf6144758481a21d26"
server_key_iv: "1065e32cc306dfcb1dc115c2d7c15d0b"
server_key_version: "encryptionkey@0"
I20260810 21:04:24.919353 18428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "0586dd2d53ad46219281bda1ea2ba060"
format_stamp: "Formatted at 2026-08-10 21:04:24 on dist-test-slave-jq4t"
server_key: "a998d3bae5c09dcf6144758481a21d26"
server_key_iv: "1065e32cc306dfcb1dc115c2d7c15d0b"
server_key_version: "encryptionkey@0"
I20260810 21:04:24.920866 18428 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:04:24.921671 18450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:24.921850 18428 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:24.921981 18428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "0586dd2d53ad46219281bda1ea2ba060"
format_stamp: "Formatted at 2026-08-10 21:04:24 on dist-test-slave-jq4t"
server_key: "a998d3bae5c09dcf6144758481a21d26"
server_key_iv: "1065e32cc306dfcb1dc115c2d7c15d0b"
server_key_version: "encryptionkey@0"
I20260810 21:04:24.922062 18428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:24.932346 18428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:24.934918 18428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:24.935108 18428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:24.935732 18428 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:24.935796 18428 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:24.935840 18428 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:24.935868 18428 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 21:04:24 dist-test-slave-jq4t krb5kdc[18243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395864, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:24.943881 18428 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:40485
I20260810 21:04:24.944120 18630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:40485 every 8 connection(s)
I20260810 21:04:24.944334 18428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:04:24.946348 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:24.936262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:47917 (local address 127.15.37.62:38457)
0810 21:04:24.936320 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:24.936322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:24.936582 (+ 260us) server_negotiation.cc:407] Connection header received
0810 21:04:24.937165 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:24.937167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:24.937181 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:24.937248 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:24.937965 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:24.938585 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:24.939633 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:24.939891 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:24.939993 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:24.943432 (+ 3439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:24.943434 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:24.943435 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:24.943447 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:24.945214 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:24.945608 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:24.945608 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:24.945609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:24.945665 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:24.945857 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:24.945858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:24.945858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:24.945969 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:24.946016 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:24.946212 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 21:04:24.946284 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 21:04:24.946584 18466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:24.936250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:38457 (local address 127.15.37.1:47917)
0810 21:04:24.936407 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:24.936451 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:24.937047 (+ 596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:24.937326 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:24.937329 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:24.937591 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:24.937846 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:24.937852 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:24.938686 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:24.938687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:24.939532 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:24.939534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:24.940010 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:24.940011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:24.940177 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:24.940786 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:24.940798 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:24.943310 (+ 2512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:24.945301 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:24.945306 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:24.945307 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:24.945536 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:24.945724 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:24.945725 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:24.945725 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:24.945815 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:24.946006 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:24.946008 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:24.946123 (+ 115us) client_negotiation.cc:769] Sending connection context
0810 21:04:24.946199 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 21:04:24.946324 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":95,"threads_started":1}
I20260810 21:04:24.947136 18632 heartbeater.cc:347] Connected to a master server at 127.15.37.62:38457
I20260810 21:04:24.947224 18632 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:24.947415 18632 heartbeater.cc:511] Master 127.15.37.62:38457 requested a full tablet report, sending...
I20260810 21:04:24.948014 18315 ts_manager.cc:194] Registered new tserver with Master: 0586dd2d53ad46219281bda1ea2ba060 (127.15.37.1:40485)
I20260810 21:04:24.948685 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 18428
I20260810 21:04:24.948798 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:04:24.948916 18315 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:47917
I20260810 21:04:24.949043 15508 external_mini_cluster.cc:1428] Setting key 83b2f990cfeab7e54b6e5faeab88370c
I20260810 21:04:24.955250 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:24.948374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:49467 (local address 127.15.37.62:38457)
0810 21:04:24.948429 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:24.948431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:24.948570 (+ 139us) server_negotiation.cc:407] Connection header received
0810 21:04:24.948680 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:24.948681 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:24.948693 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:24.948724 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:24.949174 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:24.949721 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:24.950650 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:24.950845 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:24.950902 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:24.952097 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:24.952099 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:24.952100 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:24.952118 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:24.953911 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:24.954391 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:24.954392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:24.954392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:24.954449 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:24.954692 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:24.954693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:24.954694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:24.954825 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:24.954905 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:24.955100 (+ 195us) server_negotiation.cc:299] Negotiation successful
0810 21:04:24.955179 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 21:04:24.955407 18642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:24.948308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:38457 (local address 127.15.37.1:49467)
0810 21:04:24.948499 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:24.948512 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:24.948599 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:24.948805 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:24.948806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:24.949024 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:24.949098 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:24.949101 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:24.949832 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:24.949834 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:24.950568 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:24.950572 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:24.950925 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:24.950926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:24.951020 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:24.951444 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:24.951450 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:24.951907 (+ 457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:24.954013 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:24.954014 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:24.954015 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:24.954291 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:24.954518 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:24.954520 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:24.954520 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:24.954600 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:24.954925 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:24.954926 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:24.955000 (+ 74us) client_negotiation.cc:769] Sending connection context
0810 21:04:24.955084 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 21:04:24.955233 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:04:24.980684 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38457
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:37527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:25.069566 18647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:25.069801 18647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:25.069831 18647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:25.071017 18647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:25.071060 18647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:25.071081 18647 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 21:04:25.071094 18647 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 21:04:25.071111 18647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:04:25.072731 18647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.37.62:38457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:25.072970 18647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:25.073165 18647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:25.078821 18663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:25.078878 18647 server_base.cc:1034] running on GCE node
W20260810 21:04:25.078846 18659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:25.078842 18656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:25.079285 18647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:25.079574 18647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:25.080741 18647 hybrid_clock.cc:648] HybridClock initialized: now 1786395865080732 us; error 44 us; skew 500 ppm
Aug 10 21:04:25 dist-test-slave-jq4t krb5kdc[18243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395865, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:25.083398 18647 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:04:25.083997 18647 webserver.cc:460] Webserver started at http://127.15.37.2:39407/ using document root <none> and password file <none>
I20260810 21:04:25.084271 18647 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:25.084347 18647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:25.084564 18647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:25.085698 18647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "fe6985f2b40b403aa46d33e2a42309f4"
format_stamp: "Formatted at 2026-08-10 21:04:25 on dist-test-slave-jq4t"
server_key: "d2d0cb316578b3608c84f505e8b098d8"
server_key_iv: "d65c9e69c2bbb2657b9cab720512298e"
server_key_version: "encryptionkey@0"
I20260810 21:04:25.086094 18647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "fe6985f2b40b403aa46d33e2a42309f4"
format_stamp: "Formatted at 2026-08-10 21:04:25 on dist-test-slave-jq4t"
server_key: "d2d0cb316578b3608c84f505e8b098d8"
server_key_iv: "d65c9e69c2bbb2657b9cab720512298e"
server_key_version: "encryptionkey@0"
I20260810 21:04:25.087739 18647 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:25.088557 18676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:25.088742 18647 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:25.088848 18647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "fe6985f2b40b403aa46d33e2a42309f4"
format_stamp: "Formatted at 2026-08-10 21:04:25 on dist-test-slave-jq4t"
server_key: "d2d0cb316578b3608c84f505e8b098d8"
server_key_iv: "d65c9e69c2bbb2657b9cab720512298e"
server_key_version: "encryptionkey@0"
I20260810 21:04:25.088936 18647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:25.100260 18647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:25.102635 18647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:25.102818 18647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:25.103493 18647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:25.103550 18647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:25.103585 18647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:25.103609 18647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 21:04:25 dist-test-slave-jq4t krb5kdc[18243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395865, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:25.111383 18647 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:46179
I20260810 21:04:25.111475 18864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:46179 every 8 connection(s)
I20260810 21:04:25.111896 18647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:04:25.113602 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.104011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:46735 (local address 127.15.37.62:38457)
0810 21:04:25.104094 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.104097 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.104289 (+ 192us) server_negotiation.cc:407] Connection header received
0810 21:04:25.104891 (+ 602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.104893 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.104908 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.105008 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:25.105632 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.106497 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.107697 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.108055 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.108133 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.110507 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:25.110508 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:25.110509 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:25.110519 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:25.112397 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:25.112844 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:25.112845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:25.112845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:25.112903 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:25.113101 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:25.113101 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:25.113102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:25.113214 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:25.113261 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.113462 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.113536 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 21:04:25.113831 18690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.103967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:38457 (local address 127.15.37.2:46735)
0810 21:04:25.104145 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.104190 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.104784 (+ 594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.105104 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.105107 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.105353 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:25.105552 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.105557 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.106629 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.106630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.107612 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.107615 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.108179 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.108180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.108311 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.108923 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:25.108933 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:25.110399 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:25.112523 (+ 2124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:25.112527 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:25.112529 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:25.112772 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:25.112955 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:25.112955 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:25.112955 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:25.113044 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:25.113251 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:25.113253 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:25.113372 (+ 119us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.113441 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.113573 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":100,"threads_started":1}
I20260810 21:04:25.114383 18865 heartbeater.cc:347] Connected to a master server at 127.15.37.62:38457
I20260810 21:04:25.114506 18865 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:25.114699 18865 heartbeater.cc:511] Master 127.15.37.62:38457 requested a full tablet report, sending...
I20260810 21:04:25.115124 18316 ts_manager.cc:194] Registered new tserver with Master: fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2:46179)
I20260810 21:04:25.115700 18316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:46735
I20260810 21:04:25.117249 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 18647
I20260810 21:04:25.117353 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:04:25.117569 15508 external_mini_cluster.cc:1428] Setting key f8fae11b4f52994aa6aedf2fc29ab2f2
I20260810 21:04:25.121945 18876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.115598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:38457 (local address 127.15.37.2:50667)
0810 21:04:25.115818 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.115830 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.115910 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.116021 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.116021 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.116205 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:25.116267 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.116269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.117082 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.117083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.117901 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.117904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.118300 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.118301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.118379 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.118891 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:25.118895 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:25.119237 (+ 342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:25.120800 (+ 1563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:25.120801 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:25.120802 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:25.120987 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:25.121205 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:25.121205 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:25.121206 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:25.121271 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:25.121661 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:25.121662 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:25.121708 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.121776 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.121865 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":152,"threads_started":1}
I20260810 21:04:25.122041 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.115650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:50667 (local address 127.15.37.62:38457)
0810 21:04:25.115692 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.115693 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.115882 (+ 189us) server_negotiation.cc:407] Connection header received
0810 21:04:25.115966 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.115966 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.115975 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.116014 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:25.116351 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.116957 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.118005 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.118221 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.118300 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.119324 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:25.119326 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:25.119326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:25.119333 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:25.120718 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:25.121074 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:25.121076 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:25.121077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:25.121135 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:25.121342 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:25.121344 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:25.121344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:25.121576 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:25.121649 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.121822 (+ 173us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.121911 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:04:25.147502 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38457
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:37527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:25.235569 18885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:25.235800 18885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:25.235836 18885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:25.237154 18885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:25.237202 18885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:25.237224 18885 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 21:04:25.237272 18885 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 21:04:25.237298 18885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:04:25.238869 18885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.37.62:38457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:25.239133 18885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:25.239395 18885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:25.244760 18890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:25.244787 18891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:25.244788 18893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:25.244980 18885 server_base.cc:1034] running on GCE node
I20260810 21:04:25.245189 18885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:25.245462 18885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:25.246629 18885 hybrid_clock.cc:648] HybridClock initialized: now 1786395865246614 us; error 50 us; skew 500 ppm
Aug 10 21:04:25 dist-test-slave-jq4t krb5kdc[18243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395865, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:25.253388 18885 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:04:25.253899 18885 webserver.cc:460] Webserver started at http://127.15.37.3:42943/ using document root <none> and password file <none>
I20260810 21:04:25.254165 18885 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:25.254240 18885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:25.254390 18885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:25.255551 18885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "40764c93e9094ebfa0654a2ef70f6566"
format_stamp: "Formatted at 2026-08-10 21:04:25 on dist-test-slave-jq4t"
server_key: "f6ae3570747a97d81fd0dbf9c79bfa26"
server_key_iv: "b6855abd8b9e2a932330287ec6a97efd"
server_key_version: "encryptionkey@0"
I20260810 21:04:25.255929 18885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "40764c93e9094ebfa0654a2ef70f6566"
format_stamp: "Formatted at 2026-08-10 21:04:25 on dist-test-slave-jq4t"
server_key: "f6ae3570747a97d81fd0dbf9c79bfa26"
server_key_iv: "b6855abd8b9e2a932330287ec6a97efd"
server_key_version: "encryptionkey@0"
I20260810 21:04:25.257531 18885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 21:04:25.258471 18907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:25.258698 18885 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:25.258800 18885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "40764c93e9094ebfa0654a2ef70f6566"
format_stamp: "Formatted at 2026-08-10 21:04:25 on dist-test-slave-jq4t"
server_key: "f6ae3570747a97d81fd0dbf9c79bfa26"
server_key_iv: "b6855abd8b9e2a932330287ec6a97efd"
server_key_version: "encryptionkey@0"
I20260810 21:04:25.258862 18885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:25.284842 18885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:25.287189 18885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:25.287329 18885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:25.287861 18885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:25.287949 18885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:25.287992 18885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:25.288025 18885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 21:04:25 dist-test-slave-jq4t krb5kdc[18243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395865, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:25.298458 18885 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:33821
I20260810 21:04:25.298540 19085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:33821 every 8 connection(s)
I20260810 21:04:25.298877 18885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:04:25.299682 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.288437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:50717 (local address 127.15.37.62:38457)
0810 21:04:25.288548 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.288551 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.288711 (+ 160us) server_negotiation.cc:407] Connection header received
0810 21:04:25.289218 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.289219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.289234 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.289320 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:25.290258 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.291127 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.292822 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.293278 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.293382 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.296387 (+ 3005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:25.296389 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:25.296389 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:25.296398 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:25.298067 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:25.298598 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:25.298599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:25.298600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:25.298664 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:25.298921 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:25.298922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:25.298922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:25.299075 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:25.299154 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.299489 (+ 335us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.299590 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 21:04:25.299868 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.288386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:38457 (local address 127.15.37.3:50717)
0810 21:04:25.288568 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.288612 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.289115 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.289404 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.289408 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.289819 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:25.290134 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.290141 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.291274 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.291276 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.292712 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.292715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.293392 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.293393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.293568 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.294358 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:25.294373 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:25.296269 (+ 1896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:25.298177 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:25.298185 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:25.298187 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:25.298505 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:25.298725 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:25.298725 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:25.298726 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:25.298840 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:25.299155 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:25.299163 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:25.299336 (+ 173us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.299462 (+ 126us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.299633 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":115,"threads_started":1}
I20260810 21:04:25.300410 19088 heartbeater.cc:347] Connected to a master server at 127.15.37.62:38457
I20260810 21:04:25.300549 19088 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:25.300753 19088 heartbeater.cc:511] Master 127.15.37.62:38457 requested a full tablet report, sending...
I20260810 21:04:25.301172 18316 ts_manager.cc:194] Registered new tserver with Master: 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821)
I20260810 21:04:25.301620 18316 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:50717
I20260810 21:04:25.303967 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 18885
I20260810 21:04:25.304080 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:04:25.304258 15508 external_mini_cluster.cc:1428] Setting key dc841f5a5e50bdf235faf1d3edb1d00c
I20260810 21:04:25.305449 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:04:25.307631 19097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.301593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:38457 (local address 127.15.37.3:60047)
0810 21:04:25.301730 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.301742 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.301802 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.301924 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.301924 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.302108 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:25.302173 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.302175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.302839 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.302840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.303376 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.303377 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.303751 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.303752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.303828 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.304348 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:25.304360 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:25.304806 (+ 446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:25.306667 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:25.306669 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:25.306669 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:25.306856 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:25.307060 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:25.307061 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:25.307061 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:25.307119 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:25.307389 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:25.307390 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:25.307427 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.307475 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.307556 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":84,"threads_started":1}
I20260810 21:04:25.307825 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.301641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:60047 (local address 127.15.37.62:38457)
0810 21:04:25.301689 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.301691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.301792 (+ 101us) server_negotiation.cc:407] Connection header received
0810 21:04:25.301861 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.301862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.301872 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.301921 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:25.302252 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.302740 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.303463 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.303677 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.303753 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.304911 (+ 1158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:25.304913 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:25.304913 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:25.304920 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:25.306576 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:25.306933 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:25.306935 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:25.306935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:25.307000 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:25.307179 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:25.307180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:25.307180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:25.307328 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:25.307404 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.307501 (+ 97us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.307586 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 10 21:04:25 dist-test-slave-jq4t krb5kdc[18243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 21:04:25 dist-test-slave-jq4t krb5kdc[18243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:25.333282 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.325656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52614 (local address 127.15.37.62:38457)
0810 21:04:25.325728 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.325730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.325739 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:04:25.325768 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.325769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.325778 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.325835 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:25.326482 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.326990 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.327752 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.327963 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.328015 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.330525 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:25.330526 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:25.330527 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:25.330543 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:25.331971 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:25.332349 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:25.332350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:25.332351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:25.332413 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:25.332730 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:25.332731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:25.332731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:25.332862 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:25.332952 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.333085 (+ 133us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.333162 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 21:04:25.335060 18316 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52614:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:25.336773 18316 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:25.344293 19112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.339544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:40485 (local address 127.0.0.1:34200)
0810 21:04:25.339883 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.339930 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.340008 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.340302 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.340305 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.340307 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:25.340400 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.340402 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.341820 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.341821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.342964 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.342968 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.343927 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.343928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.344027 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.344046 (+ 19us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.344125 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.344201 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":105,"thread_start_us":101,"threads_started":1}
I20260810 21:04:25.344307 19114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.339672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34200 (local address 127.15.37.1:40485)
0810 21:04:25.340117 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.340121 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.340131 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:04:25.340175 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.340176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.340194 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.340284 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:25.340538 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.341728 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.343063 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.343832 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.343915 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.343998 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.344157 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.344201 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":85,"threads_started":1}
I20260810 21:04:25.344334 19119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.339736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34822 (local address 127.15.37.2:46179)
0810 21:04:25.339985 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.339991 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.340017 (+ 26us) server_negotiation.cc:407] Connection header received
0810 21:04:25.340143 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.340147 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.340165 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.340466 (+ 301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:25.340600 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.341696 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.343220 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.343932 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.344001 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.344053 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.344186 (+ 133us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.344231 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":105,"threads_started":1}
I20260810 21:04:25.344851 19113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.339518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:46179 (local address 127.0.0.1:34822)
0810 21:04:25.339883 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.339930 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.340008 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.340330 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.340331 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.340333 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:25.340400 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.340403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.341783 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.341784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.343130 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.343132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.344010 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.344011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.344074 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.344077 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.344128 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.344781 (+ 653us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"mutex_wait_us":699,"thread_start_us":57,"threads_started":1}
I20260810 21:04:25.345338 18534 tablet_service.cc:1467] Processing CreateTablet for tablet 63114ee50ea545c5a9d6881032b994d2 (DEFAULT_TABLE table=test-table [id=cbfdc44dca6f41c28f3e80349b408a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:25.345534 19116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.339763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:33821 (local address 127.0.0.1:58784)
0810 21:04:25.340404 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.340414 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.340609 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.340822 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.340823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.340824 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:25.340874 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.340876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.341731 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.341733 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.343125 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.343128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.345251 (+ 2123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.345258 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.345307 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.345312 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.345386 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.345432 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"mutex_wait_us":49,"thread_start_us":65,"threads_started":1}
I20260810 21:04:25.345486 18737 tablet_service.cc:1467] Processing CreateTablet for tablet 63114ee50ea545c5a9d6881032b994d2 (DEFAULT_TABLE table=test-table [id=cbfdc44dca6f41c28f3e80349b408a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:25.345541 19124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.339920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58784 (local address 127.15.37.3:33821)
0810 21:04:25.340219 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.340224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.340669 (+ 445us) server_negotiation.cc:407] Connection header received
0810 21:04:25.340719 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.340721 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.340733 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.340824 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:25.340953 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.341641 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.344120 (+ 2479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.345086 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.345158 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.345214 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.345402 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.345440 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":215,"threads_started":1}
I20260810 21:04:25.345793 18737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63114ee50ea545c5a9d6881032b994d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:25.345793 18534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63114ee50ea545c5a9d6881032b994d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:25.346230 18983 tablet_service.cc:1467] Processing CreateTablet for tablet 63114ee50ea545c5a9d6881032b994d2 (DEFAULT_TABLE table=test-table [id=cbfdc44dca6f41c28f3e80349b408a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:25.346597 18983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63114ee50ea545c5a9d6881032b994d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:25.349586 19126 tablet_bootstrap.cc:492] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566: Bootstrap starting.
I20260810 21:04:25.349962 19127 tablet_bootstrap.cc:492] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060: Bootstrap starting.
I20260810 21:04:25.350214 19128 tablet_bootstrap.cc:492] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4: Bootstrap starting.
I20260810 21:04:25.350616 19126 tablet_bootstrap.cc:654] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:25.350616 19127 tablet_bootstrap.cc:654] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:25.350853 19128 tablet_bootstrap.cc:654] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:25.351022 19126 log.cc:824] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:25.351024 19127 log.cc:824] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:25.351240 19128 log.cc:824] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:25.352139 19126 tablet_bootstrap.cc:492] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566: No bootstrap required, opened a new log
I20260810 21:04:25.352139 19128 tablet_bootstrap.cc:492] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4: No bootstrap required, opened a new log
I20260810 21:04:25.352223 19126 ts_tablet_manager.cc:1397] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:04:25.352223 19128 ts_tablet_manager.cc:1397] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:04:25.352272 19127 tablet_bootstrap.cc:492] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060: No bootstrap required, opened a new log
I20260810 21:04:25.352344 19127 ts_tablet_manager.cc:1397] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:04:25.353821 19127 raft_consensus.cc:348] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.354002 19127 raft_consensus.cc:374] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:25.354049 19127 raft_consensus.cc:729] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0586dd2d53ad46219281bda1ea2ba060, State: Initialized, Role: FOLLOWER
I20260810 21:04:25.354169 19127 consensus_queue.cc:260] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.354331 19128 raft_consensus.cc:348] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.354324 19126 raft_consensus.cc:348] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.354491 19128 raft_consensus.cc:374] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:25.354491 19126 raft_consensus.cc:374] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:25.354496 19127 ts_tablet_manager.cc:1428] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:04:25.354535 19126 raft_consensus.cc:729] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40764c93e9094ebfa0654a2ef70f6566, State: Initialized, Role: FOLLOWER
I20260810 21:04:25.354535 19128 raft_consensus.cc:729] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6985f2b40b403aa46d33e2a42309f4, State: Initialized, Role: FOLLOWER
I20260810 21:04:25.354626 18632 heartbeater.cc:503] Master 127.15.37.62:38457 was elected leader, sending a full tablet report...
I20260810 21:04:25.354666 19126 consensus_queue.cc:260] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.354681 19128 consensus_queue.cc:260] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.354951 19126 ts_tablet_manager.cc:1428] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:04:25.354951 19128 ts_tablet_manager.cc:1428] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:04:25.355078 19088 heartbeater.cc:503] Master 127.15.37.62:38457 was elected leader, sending a full tablet report...
I20260810 21:04:25.355124 18865 heartbeater.cc:503] Master 127.15.37.62:38457 was elected leader, sending a full tablet report...
W20260810 21:04:25.362483 18867 tablet.cc:2369] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:04:25.411679 19132 raft_consensus.cc:482] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:25.411840 19132 raft_consensus.cc:504] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.412356 19132 leader_election.cc:288] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2:46179), 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821)
I20260810 21:04:25.416659 19119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.412759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:43197 (local address 127.15.37.2:46179)
0810 21:04:25.412814 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.412817 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.412833 (+ 16us) server_negotiation.cc:407] Connection header received
0810 21:04:25.412929 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.412930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.412962 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.413040 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:25.413261 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.414069 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.415656 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.416238 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.416301 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.416312 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.416528 (+ 216us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.416583 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 21:04:25.416659 19124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.412850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:42709 (local address 127.15.37.3:33821)
0810 21:04:25.412902 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.412904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.412997 (+ 93us) server_negotiation.cc:407] Connection header received
0810 21:04:25.413081 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.413081 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.413093 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.413158 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:25.413348 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.414063 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.415657 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.416218 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.416300 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.416312 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.416528 (+ 216us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.416583 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 21:04:25.416661 18466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.412662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:46179 (local address 127.15.37.1:43197)
0810 21:04:25.412729 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.412743 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.412805 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.413064 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.413065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.413067 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:25.413153 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.413154 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.414162 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.414164 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.415551 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.415555 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.416319 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.416320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.416407 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.416414 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.416528 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.416563 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":71}
I20260810 21:04:25.416675 19137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.412727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:33821 (local address 127.15.37.1:42709)
0810 21:04:25.412921 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.412929 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.413013 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.413176 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.413177 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.413179 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:25.413267 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.413270 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.414162 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.414164 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.415551 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.415555 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.416319 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.416320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.416407 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.416414 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.416512 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.416561 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":75,"thread_start_us":131,"threads_started":1}
I20260810 21:04:25.417197 19013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63114ee50ea545c5a9d6881032b994d2" candidate_uuid: "0586dd2d53ad46219281bda1ea2ba060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40764c93e9094ebfa0654a2ef70f6566" is_pre_election: true
I20260810 21:04:25.417232 18792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63114ee50ea545c5a9d6881032b994d2" candidate_uuid: "0586dd2d53ad46219281bda1ea2ba060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6985f2b40b403aa46d33e2a42309f4" is_pre_election: true
I20260810 21:04:25.417383 19013 raft_consensus.cc:2454] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0586dd2d53ad46219281bda1ea2ba060 in term 0.
I20260810 21:04:25.417383 18792 raft_consensus.cc:2454] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0586dd2d53ad46219281bda1ea2ba060 in term 0.
I20260810 21:04:25.417465 19134 raft_consensus.cc:482] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:25.417557 19134 raft_consensus.cc:504] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.417882 18455 leader_election.cc:302] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0586dd2d53ad46219281bda1ea2ba060, fe6985f2b40b403aa46d33e2a42309f4; no voters:
I20260810 21:04:25.418032 19134 leader_election.cc:288] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0586dd2d53ad46219281bda1ea2ba060 (127.15.37.1:40485), fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2:46179)
I20260810 21:04:25.418092 19132 raft_consensus.cc:2781] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:25.418179 19132 raft_consensus.cc:482] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:25.418218 19132 raft_consensus.cc:3037] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:25.419366 19132 raft_consensus.cc:504] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.419524 19132 leader_election.cc:288] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [CANDIDATE]: Term 1 election: Requested vote from peers fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2:46179), 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821)
I20260810 21:04:25.419759 18792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63114ee50ea545c5a9d6881032b994d2" candidate_uuid: "0586dd2d53ad46219281bda1ea2ba060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6985f2b40b403aa46d33e2a42309f4"
I20260810 21:04:25.419826 19013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63114ee50ea545c5a9d6881032b994d2" candidate_uuid: "0586dd2d53ad46219281bda1ea2ba060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40764c93e9094ebfa0654a2ef70f6566"
I20260810 21:04:25.419858 18792 raft_consensus.cc:3037] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:25.419890 19013 raft_consensus.cc:3037] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:25.420929 18792 raft_consensus.cc:2454] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0586dd2d53ad46219281bda1ea2ba060 in term 1.
I20260810 21:04:25.421259 18455 leader_election.cc:302] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0586dd2d53ad46219281bda1ea2ba060, fe6985f2b40b403aa46d33e2a42309f4; no voters:
I20260810 21:04:25.421407 19132 raft_consensus.cc:2781] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:25.421427 19013 raft_consensus.cc:2454] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0586dd2d53ad46219281bda1ea2ba060 in term 1.
I20260810 21:04:25.421612 19132 raft_consensus.cc:686] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 LEADER]: Becoming Leader. State: Replica: 0586dd2d53ad46219281bda1ea2ba060, State: Running, Role: LEADER
I20260810 21:04:25.421712 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.418174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:40485 (local address 127.15.37.3:49389)
0810 21:04:25.418230 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.418241 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.418279 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.418432 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.418433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.418435 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:25.418506 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.418507 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.419403 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.419404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.420659 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.420661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.421430 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.421431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.421518 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.421522 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.421574 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.421620 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 21:04:25.421718 19132 consensus_queue.cc:237] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.421940 19119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.418528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:38589 (local address 127.15.37.2:46179)
0810 21:04:25.418599 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.418601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.418732 (+ 131us) server_negotiation.cc:407] Connection header received
0810 21:04:25.418820 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.418821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.418830 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.418891 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:25.419065 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.419723 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.420951 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.421476 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.421530 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.421539 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.421735 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.421882 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 21:04:25.421941 19114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.418256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:49389 (local address 127.15.37.1:40485)
0810 21:04:25.418299 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.418301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.418311 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:04:25.418334 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.418334 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.418346 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.418410 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:25.418598 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.419310 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.420757 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.421302 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.421366 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.421377 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.421832 (+ 455us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.421879 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 21:04:25.422165 19138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.418432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:46179 (local address 127.15.37.3:38589)
0810 21:04:25.418672 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.418683 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.418757 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.418910 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.418911 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.418912 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:25.418982 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.418983 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.419818 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.419819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.420861 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.420863 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.421596 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.421596 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.421655 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.421658 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.422069 (+ 411us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.422116 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":137,"threads_started":1}
I20260810 21:04:25.422385 18792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63114ee50ea545c5a9d6881032b994d2" candidate_uuid: "40764c93e9094ebfa0654a2ef70f6566" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6985f2b40b403aa46d33e2a42309f4" is_pre_election: true
I20260810 21:04:25.422431 18565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63114ee50ea545c5a9d6881032b994d2" candidate_uuid: "40764c93e9094ebfa0654a2ef70f6566" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0586dd2d53ad46219281bda1ea2ba060" is_pre_election: true
I20260810 21:04:25.422487 18792 raft_consensus.cc:2379] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40764c93e9094ebfa0654a2ef70f6566 in current term 1: Already voted for candidate 0586dd2d53ad46219281bda1ea2ba060 in this term.
I20260810 21:04:25.422699 18316 catalog_manager.cc:5495] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0586dd2d53ad46219281bda1ea2ba060 (127.15.37.1). New cstate: current_term: 1 leader_uuid: "0586dd2d53ad46219281bda1ea2ba060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } health_report { overall_health: UNKNOWN } } }
I20260810 21:04:25.422969 18909 leader_election.cc:302] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40764c93e9094ebfa0654a2ef70f6566; no voters: 0586dd2d53ad46219281bda1ea2ba060, fe6985f2b40b403aa46d33e2a42309f4
I20260810 21:04:25.423208 19134 raft_consensus.cc:2726] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 21:04:25.445442 18635 tablet.cc:2369] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 21:04:25 dist-test-slave-jq4t krb5kdc[18243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395864, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:25.461082 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.453531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52626 (local address 127.15.37.62:38457)
0810 21:04:25.453645 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.453648 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.453743 (+ 95us) server_negotiation.cc:407] Connection header received
0810 21:04:25.453837 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.453838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.453851 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.453929 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:25.454426 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.454943 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.455653 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.455848 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.455923 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.458323 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:25.458325 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:25.458325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:25.458332 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:25.459714 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:25.460122 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:25.460123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:25.460123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:25.460187 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:25.460393 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:25.460394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:25.460395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:25.460581 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:25.460657 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.460817 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.460966 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":72}
I20260810 21:04:25.461165 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.453465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:38457 (local address 127.0.0.1:52626)
0810 21:04:25.453656 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.453667 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.453766 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.453936 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.453937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.454286 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:25.454341 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.454344 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.455027 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.455028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.455570 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.455571 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.455922 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.455923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.455988 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.456626 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:25.456632 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:25.458228 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:25.459816 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:25.459824 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:25.459827 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:25.460043 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:25.460257 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:25.460258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:25.460259 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:25.460343 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:25.460646 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:25.460655 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:25.460705 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.460792 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.461031 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":121,"thread_start_us":127,"threads_started":1}
I20260810 21:04:25.463472 18316 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:52626:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 21:04:25.463706 18316 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:25.465375 18534 tablet_service.cc:1467] Processing CreateTablet for tablet 71f22a7a4e8d43f0a8fbefa752bff619 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c423362934554ac08e5e305908cff000]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 21:04:25.465427 18737 tablet_service.cc:1467] Processing CreateTablet for tablet 71f22a7a4e8d43f0a8fbefa752bff619 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c423362934554ac08e5e305908cff000]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 21:04:25.465520 18983 tablet_service.cc:1467] Processing CreateTablet for tablet 71f22a7a4e8d43f0a8fbefa752bff619 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c423362934554ac08e5e305908cff000]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 21:04:25.465588 18534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71f22a7a4e8d43f0a8fbefa752bff619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:25.465652 18737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71f22a7a4e8d43f0a8fbefa752bff619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:25.465659 18983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71f22a7a4e8d43f0a8fbefa752bff619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:25.467073 19127 tablet_bootstrap.cc:492] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060: Bootstrap starting.
I20260810 21:04:25.467247 19128 tablet_bootstrap.cc:492] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4: Bootstrap starting.
I20260810 21:04:25.467257 19126 tablet_bootstrap.cc:492] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566: Bootstrap starting.
I20260810 21:04:25.467566 19127 tablet_bootstrap.cc:654] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:25.467661 19126 tablet_bootstrap.cc:654] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:25.468040 19128 tablet_bootstrap.cc:654] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:25.468372 19127 tablet_bootstrap.cc:492] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060: No bootstrap required, opened a new log
I20260810 21:04:25.468429 19127 ts_tablet_manager.cc:1397] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:25.468629 19127 raft_consensus.cc:348] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.468717 19127 raft_consensus.cc:374] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:25.468740 19127 raft_consensus.cc:729] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0586dd2d53ad46219281bda1ea2ba060, State: Initialized, Role: FOLLOWER
I20260810 21:04:25.468771 19128 tablet_bootstrap.cc:492] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4: No bootstrap required, opened a new log
I20260810 21:04:25.468813 19128 ts_tablet_manager.cc:1397] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:04:25.468796 19127 consensus_queue.cc:260] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.468906 19127 ts_tablet_manager.cc:1428] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:25.468974 19128 raft_consensus.cc:348] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.469058 19128 raft_consensus.cc:374] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:25.468971 19132 tablet_replica.cc:439] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } } }
I20260810 21:04:25.469080 19128 raft_consensus.cc:729] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6985f2b40b403aa46d33e2a42309f4, State: Initialized, Role: FOLLOWER
I20260810 21:04:25.469089 19132 tablet_replica.cc:442] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:25.469126 19128 consensus_queue.cc:260] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.469210 19128 ts_tablet_manager.cc:1428] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:25.469267 19136 tablet_replica.cc:439] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } } }
I20260810 21:04:25.469375 19136 tablet_replica.cc:442] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:25.469640 19126 tablet_bootstrap.cc:492] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566: No bootstrap required, opened a new log
I20260810 21:04:25.469695 19126 ts_tablet_manager.cc:1397] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:04:25.469851 19126 raft_consensus.cc:348] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.469933 19126 raft_consensus.cc:374] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:25.469952 19126 raft_consensus.cc:729] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40764c93e9094ebfa0654a2ef70f6566, State: Initialized, Role: FOLLOWER
I20260810 21:04:25.470028 19126 consensus_queue.cc:260] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.470135 19126 ts_tablet_manager.cc:1428] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:25.470204 19134 tablet_replica.cc:439] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } } }
I20260810 21:04:25.470321 19134 tablet_replica.cc:442] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566: This TxnStatusTablet replica's current role is: FOLLOWER
W20260810 21:04:25.549659 19090 tablet.cc:2369] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:04:25.840938 19132 raft_consensus.cc:482] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:25.841070 19132 raft_consensus.cc:504] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.841285 19132 leader_election.cc:288] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2:46179), 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821)
I20260810 21:04:25.841609 18792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f22a7a4e8d43f0a8fbefa752bff619" candidate_uuid: "0586dd2d53ad46219281bda1ea2ba060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6985f2b40b403aa46d33e2a42309f4" is_pre_election: true
I20260810 21:04:25.841609 19013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f22a7a4e8d43f0a8fbefa752bff619" candidate_uuid: "0586dd2d53ad46219281bda1ea2ba060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40764c93e9094ebfa0654a2ef70f6566" is_pre_election: true
I20260810 21:04:25.841728 18792 raft_consensus.cc:2454] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0586dd2d53ad46219281bda1ea2ba060 in term 0.
I20260810 21:04:25.841724 19013 raft_consensus.cc:2454] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0586dd2d53ad46219281bda1ea2ba060 in term 0.
I20260810 21:04:25.841934 18455 leader_election.cc:302] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0586dd2d53ad46219281bda1ea2ba060, fe6985f2b40b403aa46d33e2a42309f4; no voters:
I20260810 21:04:25.842057 19132 raft_consensus.cc:2781] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:25.842108 19132 raft_consensus.cc:482] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:25.842123 19132 raft_consensus.cc:3037] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:25.842808 19132 raft_consensus.cc:504] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.842980 19132 leader_election.cc:288] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [CANDIDATE]: Term 1 election: Requested vote from peers fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2:46179), 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821)
I20260810 21:04:25.843179 19013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f22a7a4e8d43f0a8fbefa752bff619" candidate_uuid: "0586dd2d53ad46219281bda1ea2ba060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40764c93e9094ebfa0654a2ef70f6566"
I20260810 21:04:25.843179 18792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71f22a7a4e8d43f0a8fbefa752bff619" candidate_uuid: "0586dd2d53ad46219281bda1ea2ba060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6985f2b40b403aa46d33e2a42309f4"
I20260810 21:04:25.843267 19013 raft_consensus.cc:3037] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:25.843267 18792 raft_consensus.cc:3037] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:25.844062 18792 raft_consensus.cc:2454] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0586dd2d53ad46219281bda1ea2ba060 in term 1.
I20260810 21:04:25.844067 19013 raft_consensus.cc:2454] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0586dd2d53ad46219281bda1ea2ba060 in term 1.
I20260810 21:04:25.844309 18451 leader_election.cc:302] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0586dd2d53ad46219281bda1ea2ba060, 40764c93e9094ebfa0654a2ef70f6566; no voters:
I20260810 21:04:25.844420 19132 raft_consensus.cc:2781] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:25.844497 19132 raft_consensus.cc:686] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 LEADER]: Becoming Leader. State: Replica: 0586dd2d53ad46219281bda1ea2ba060, State: Running, Role: LEADER
I20260810 21:04:25.844561 19132 consensus_queue.cc:237] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.844911 19139 tablet_replica.cc:439] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060: TxnStatusTablet state changed. Reason: New leader 0586dd2d53ad46219281bda1ea2ba060. Latest consensus state: current_term: 1 leader_uuid: "0586dd2d53ad46219281bda1ea2ba060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } } }
I20260810 21:04:25.845031 19139 tablet_replica.cc:442] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060: This TxnStatusTablet replica's current role is: LEADER
I20260810 21:04:25.845237 19153 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 21:04:25.845238 18316 catalog_manager.cc:5495] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0586dd2d53ad46219281bda1ea2ba060 (127.15.37.1). New cstate: current_term: 1 leader_uuid: "0586dd2d53ad46219281bda1ea2ba060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } health_report { overall_health: UNKNOWN } } }
I20260810 21:04:25.845386 19153 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 21:04:25.871943 19139 consensus_queue.cc:1035] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:25.874590 19157 consensus_queue.cc:1035] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:25.912032 19114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.909252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34212 (local address 127.15.37.1:40485)
0810 21:04:25.909310 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.909312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.909323 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:04:25.909395 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.909397 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.909417 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.909491 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:25.909615 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.910348 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.911121 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.911407 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.911490 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.911657 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:25.911786 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:25.911875 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.911898 (+ 23us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.911922 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 21:04:25.912062 19148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.909166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:40485 (local address 127.0.0.1:34212)
0810 21:04:25.909254 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.909268 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.909327 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.909502 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.909503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.909504 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 21:04:25.909556 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.909558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.910434 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.910434 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.911026 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.911028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.911494 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.911495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.911543 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.911559 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 21:04:25.911857 (+ 298us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 21:04:25.911864 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.911892 (+ 28us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.911931 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 21:04:25.913795 18792 raft_consensus.cc:1261] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Refusing update from remote peer 0586dd2d53ad46219281bda1ea2ba060: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:25.913808 19013 raft_consensus.cc:1261] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Refusing update from remote peer 0586dd2d53ad46219281bda1ea2ba060: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:25.914067 19139 consensus_queue.cc:1035] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:25.914165 19157 consensus_queue.cc:1035] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:25.915167 19136 tablet_replica.cc:439] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4: TxnStatusTablet state changed. Reason: New leader 0586dd2d53ad46219281bda1ea2ba060. Latest consensus state: current_term: 1 leader_uuid: "0586dd2d53ad46219281bda1ea2ba060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } } }
I20260810 21:04:25.915261 19136 tablet_replica.cc:442] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:25.915789 19134 tablet_replica.cc:439] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566: TxnStatusTablet state changed. Reason: New leader 0586dd2d53ad46219281bda1ea2ba060. Latest consensus state: current_term: 1 leader_uuid: "0586dd2d53ad46219281bda1ea2ba060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } } }
I20260810 21:04:25.915894 19134 tablet_replica.cc:442] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:25.916227 19139 tablet_replica.cc:439] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0586dd2d53ad46219281bda1ea2ba060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } } }
I20260810 21:04:25.916326 19139 tablet_replica.cc:442] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060: This TxnStatusTablet replica's current role is: LEADER
I20260810 21:04:25.916383 19156 mvcc.cc:205] Tried to move back new op lower bound from 7317077466780602368 to 7317077466499604480. Current Snapshot: MvccSnapshot[applied={T|T < 7317077466780602368}]
I20260810 21:04:25.916306 19161 mvcc.cc:205] Tried to move back new op lower bound from 7317077466780602368 to 7317077466499604480. Current Snapshot: MvccSnapshot[applied={T|T < 7317077466780602368}]
I20260810 21:04:25.916510 19136 tablet_replica.cc:439] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0586dd2d53ad46219281bda1ea2ba060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } } }
I20260810 21:04:25.916599 19136 tablet_replica.cc:442] T 71f22a7a4e8d43f0a8fbefa752bff619 P fe6985f2b40b403aa46d33e2a42309f4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:25.918051 19132 tablet_replica.cc:439] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0586dd2d53ad46219281bda1ea2ba060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } } }
I20260810 21:04:25.918134 19132 tablet_replica.cc:442] T 71f22a7a4e8d43f0a8fbefa752bff619 P 0586dd2d53ad46219281bda1ea2ba060: This TxnStatusTablet replica's current role is: LEADER
I20260810 21:04:25.918628 19158 mvcc.cc:205] Tried to move back new op lower bound from 7317077466780602368 to 7317077466499604480. Current Snapshot: MvccSnapshot[applied={T|T < 7317077466780602368}]
I20260810 21:04:25.918917 19134 tablet_replica.cc:439] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0586dd2d53ad46219281bda1ea2ba060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } } }
I20260810 21:04:25.919025 19134 tablet_replica.cc:442] T 71f22a7a4e8d43f0a8fbefa752bff619 P 40764c93e9094ebfa0654a2ef70f6566: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:25.922154 19114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.919375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34218 (local address 127.15.37.1:40485)
0810 21:04:25.919430 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.919432 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.919490 (+ 58us) server_negotiation.cc:407] Connection header received
0810 21:04:25.919565 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.919566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.919580 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.919652 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:25.919743 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.920455 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.921278 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.921573 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.921657 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.921785 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:25.921823 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:25.921901 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.922032 (+ 131us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.922057 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 21:04:25.927613 19114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.925061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:53925 (local address 127.15.37.1:40485)
0810 21:04:25.925111 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.925113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.925279 (+ 166us) server_negotiation.cc:407] Connection header received
0810 21:04:25.925352 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.925353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.925362 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.925405 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:25.925562 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.926059 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.926827 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.927043 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.927116 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.927321 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:25.927361 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:25.927423 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.927483 (+ 60us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.927506 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 21:04:25.927631 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.925007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:40485 (local address 127.15.37.1:53925)
0810 21:04:25.925194 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.925204 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.925296 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.925405 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.925406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.925407 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 21:04:25.925473 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.925475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.926156 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.926156 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.926741 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.926743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.927128 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.927130 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.927190 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.927213 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 21:04:25.927424 (+ 211us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 21:04:25.927426 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.927479 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.927536 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":5,"thread_start_us":126,"threads_started":1}
I20260810 21:04:25.944178 18315 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:25.944317 18315 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:25.945168 18315 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785: Sending DeleteTablet for 3 replicas of tablet 63114ee50ea545c5a9d6881032b994d2
I20260810 21:04:25.945487 18533 tablet_service.cc:1514] Processing DeleteTablet for tablet 63114ee50ea545c5a9d6881032b994d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:25 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34200
I20260810 21:04:25.945554 18983 tablet_service.cc:1514] Processing DeleteTablet for tablet 63114ee50ea545c5a9d6881032b994d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:25 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:58784
I20260810 21:04:25.945899 19181 tablet_replica.cc:330] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566: stopping tablet replica
I20260810 21:04:25.946204 19181 raft_consensus.cc:2229] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:25.946152 18315 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52614:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:25.946308 18315 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:25.946516 19181 raft_consensus.cc:2258] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:25.946775 19179 tablet_replica.cc:330] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060: stopping tablet replica
I20260810 21:04:25.946935 19179 raft_consensus.cc:2229] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:04:25.947115 19179 raft_consensus.cc:2258] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:25.947081 18737 tablet_service.cc:1514] Processing DeleteTablet for tablet 63114ee50ea545c5a9d6881032b994d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:25 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34822
I20260810 21:04:25.947595 19181 ts_tablet_manager.cc:1905] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:25.947697 18983 tablet_service.cc:1467] Processing CreateTablet for tablet 3ec42d90fd0649cfacd44c9309fa0367 (DEFAULT_TABLE table=test-table [id=26c7e95d64c248b49e82605a75ed383e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:25.947827 18983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ec42d90fd0649cfacd44c9309fa0367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:25.948279 19182 tablet_replica.cc:330] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4: stopping tablet replica
I20260810 21:04:25.948432 19182 raft_consensus.cc:2229] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:25.948534 19182 raft_consensus.cc:2258] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:25.948999 19182 ts_tablet_manager.cc:1905] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:25.949293 19126 tablet_bootstrap.cc:492] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566: Bootstrap starting.
I20260810 21:04:25.949687 19126 tablet_bootstrap.cc:654] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:25.949724 19181 ts_tablet_manager.cc:1918] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:25.949909 19181 log.cc:1196] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/63114ee50ea545c5a9d6881032b994d2
I20260810 21:04:25.950289 19181 ts_tablet_manager.cc:1939] T 63114ee50ea545c5a9d6881032b994d2 P 40764c93e9094ebfa0654a2ef70f6566: Deleting consensus metadata
I20260810 21:04:25.950302 18737 tablet_service.cc:1467] Processing CreateTablet for tablet 3ec42d90fd0649cfacd44c9309fa0367 (DEFAULT_TABLE table=test-table [id=26c7e95d64c248b49e82605a75ed383e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:25.950412 18737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ec42d90fd0649cfacd44c9309fa0367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:25.950876 19182 ts_tablet_manager.cc:1918] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:25.950886 18291 catalog_manager.cc:4841] TS 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821): tablet 63114ee50ea545c5a9d6881032b994d2 (table test-table [id=cbfdc44dca6f41c28f3e80349b408a1a]) successfully deleted
I20260810 21:04:25.950958 19182 log.cc:1196] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/63114ee50ea545c5a9d6881032b994d2
I20260810 21:04:25.951210 19182 ts_tablet_manager.cc:1939] T 63114ee50ea545c5a9d6881032b994d2 P fe6985f2b40b403aa46d33e2a42309f4: Deleting consensus metadata
I20260810 21:04:25.951691 18295 catalog_manager.cc:4841] TS fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2:46179): tablet 63114ee50ea545c5a9d6881032b994d2 (table test-table [id=cbfdc44dca6f41c28f3e80349b408a1a]) successfully deleted
I20260810 21:04:25.951711 19128 tablet_bootstrap.cc:492] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4: Bootstrap starting.
I20260810 21:04:25.952083 19128 tablet_bootstrap.cc:654] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:25.952165 18533 tablet_service.cc:1467] Processing CreateTablet for tablet 3ec42d90fd0649cfacd44c9309fa0367 (DEFAULT_TABLE table=test-table [id=26c7e95d64c248b49e82605a75ed383e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:25.952299 18533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ec42d90fd0649cfacd44c9309fa0367. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:25.952725 19128 tablet_bootstrap.cc:492] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4: No bootstrap required, opened a new log
I20260810 21:04:25.952787 19128 ts_tablet_manager.cc:1397] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:25.952804 19126 tablet_bootstrap.cc:492] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566: No bootstrap required, opened a new log
I20260810 21:04:25.952847 19126 ts_tablet_manager.cc:1397] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260810 21:04:25.952941 19179 ts_tablet_manager.cc:1905] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:25.952952 19128 raft_consensus.cc:348] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.953048 19128 raft_consensus.cc:374] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:25.953009 19126 raft_consensus.cc:348] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.953076 19128 raft_consensus.cc:729] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6985f2b40b403aa46d33e2a42309f4, State: Initialized, Role: FOLLOWER
I20260810 21:04:25.953078 19126 raft_consensus.cc:374] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:25.953102 19126 raft_consensus.cc:729] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40764c93e9094ebfa0654a2ef70f6566, State: Initialized, Role: FOLLOWER
I20260810 21:04:25.953125 19128 consensus_queue.cc:260] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.953152 19126 consensus_queue.cc:260] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.953228 19128 ts_tablet_manager.cc:1428] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 21:04:25.953241 19126 ts_tablet_manager.cc:1428] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:25.953997 19127 tablet_bootstrap.cc:492] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060: Bootstrap starting.
I20260810 21:04:25.954679 19127 tablet_bootstrap.cc:654] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:25.955377 19127 tablet_bootstrap.cc:492] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060: No bootstrap required, opened a new log
I20260810 21:04:25.955435 19127 ts_tablet_manager.cc:1397] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:25.955593 19127 raft_consensus.cc:348] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.955687 19127 raft_consensus.cc:374] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:25.955717 19127 raft_consensus.cc:729] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0586dd2d53ad46219281bda1ea2ba060, State: Initialized, Role: FOLLOWER
I20260810 21:04:25.955771 19127 consensus_queue.cc:260] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.955873 19127 ts_tablet_manager.cc:1428] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:25.956120 19179 ts_tablet_manager.cc:1918] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:25.956213 19179 log.cc:1196] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/wal/wals/63114ee50ea545c5a9d6881032b994d2
I20260810 21:04:25.956532 19179 ts_tablet_manager.cc:1939] T 63114ee50ea545c5a9d6881032b994d2 P 0586dd2d53ad46219281bda1ea2ba060: Deleting consensus metadata
I20260810 21:04:25.957732 18291 catalog_manager.cc:4841] TS 0586dd2d53ad46219281bda1ea2ba060 (127.15.37.1:40485): tablet 63114ee50ea545c5a9d6881032b994d2 (table test-table [id=cbfdc44dca6f41c28f3e80349b408a1a]) successfully deleted
I20260810 21:04:25.974298 19136 raft_consensus.cc:482] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:25.974444 19136 raft_consensus.cc:504] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.974852 19136 leader_election.cc:288] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0586dd2d53ad46219281bda1ea2ba060 (127.15.37.1:40485), 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821)
I20260810 21:04:25.979542 19195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.975276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:33821 (local address 127.15.37.2:44277)
0810 21:04:25.975611 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.975621 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.975687 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.975987 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.975988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.975991 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:25.976075 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.976077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.977139 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.977140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.978465 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.978469 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.979260 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.979262 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.979331 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.979335 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.979386 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.979442 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":94,"threads_started":1}
I20260810 21:04:25.979816 19196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.975492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:44277 (local address 127.15.37.3:33821)
0810 21:04:25.975780 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.975782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.975791 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:04:25.975843 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.975844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.975855 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.975959 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:25.976186 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.977027 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.978576 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.979131 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.979208 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.979224 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.979674 (+ 450us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.979728 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":60,"threads_started":1}
I20260810 21:04:25.980085 19013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec42d90fd0649cfacd44c9309fa0367" candidate_uuid: "fe6985f2b40b403aa46d33e2a42309f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40764c93e9094ebfa0654a2ef70f6566" is_pre_election: true
I20260810 21:04:25.980188 19013 raft_consensus.cc:2454] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6985f2b40b403aa46d33e2a42309f4 in term 0.
I20260810 21:04:25.980353 19114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.975158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:58035 (local address 127.15.37.1:40485)
0810 21:04:25.975246 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.975248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.975385 (+ 137us) server_negotiation.cc:407] Connection header received
0810 21:04:25.976181 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.976183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.976194 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.976227 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:25.976572 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.977411 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.978803 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.979527 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.979577 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.979600 (+ 23us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.980177 (+ 577us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.980248 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 21:04:25.980645 18679 leader_election.cc:302] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40764c93e9094ebfa0654a2ef70f6566, fe6985f2b40b403aa46d33e2a42309f4; no voters:
I20260810 21:04:25.980793 19136 raft_consensus.cc:2781] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:25.980825 19136 raft_consensus.cc:482] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:25.980875 19136 raft_consensus.cc:3037] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:25.980831 19194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.975087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:40485 (local address 127.15.37.2:58035)
0810 21:04:25.975242 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:25.975255 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:25.976032 (+ 777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:25.976331 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:25.976331 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:25.976333 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:25.976434 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.976436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.977532 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.977533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.978695 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:25.978698 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.979797 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.979808 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:25.980069 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.980074 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:04:25.980619 (+ 545us) client_negotiation.cc:240] Negotiation successful
0810 21:04:25.980680 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":74,"threads_started":1}
I20260810 21:04:25.981885 18565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec42d90fd0649cfacd44c9309fa0367" candidate_uuid: "fe6985f2b40b403aa46d33e2a42309f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0586dd2d53ad46219281bda1ea2ba060" is_pre_election: true
I20260810 21:04:25.982002 18565 raft_consensus.cc:2454] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6985f2b40b403aa46d33e2a42309f4 in term 0.
I20260810 21:04:25.982144 19136 raft_consensus.cc:504] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.982283 19136 leader_election.cc:288] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [CANDIDATE]: Term 1 election: Requested vote from peers 0586dd2d53ad46219281bda1ea2ba060 (127.15.37.1:40485), 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821)
I20260810 21:04:25.982564 18565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec42d90fd0649cfacd44c9309fa0367" candidate_uuid: "fe6985f2b40b403aa46d33e2a42309f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0586dd2d53ad46219281bda1ea2ba060"
I20260810 21:04:25.982643 18565 raft_consensus.cc:3037] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:25.982815 19013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec42d90fd0649cfacd44c9309fa0367" candidate_uuid: "fe6985f2b40b403aa46d33e2a42309f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40764c93e9094ebfa0654a2ef70f6566"
I20260810 21:04:25.982887 19013 raft_consensus.cc:3037] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:25.983692 18565 raft_consensus.cc:2454] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6985f2b40b403aa46d33e2a42309f4 in term 1.
I20260810 21:04:25.983728 19013 raft_consensus.cc:2454] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6985f2b40b403aa46d33e2a42309f4 in term 1.
I20260810 21:04:25.983902 18679 leader_election.cc:302] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40764c93e9094ebfa0654a2ef70f6566, fe6985f2b40b403aa46d33e2a42309f4; no voters:
I20260810 21:04:25.984010 19136 raft_consensus.cc:2781] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:25.984179 19136 raft_consensus.cc:686] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 LEADER]: Becoming Leader. State: Replica: fe6985f2b40b403aa46d33e2a42309f4, State: Running, Role: LEADER
I20260810 21:04:25.984252 19136 consensus_queue.cc:237] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:25.985128 18316 catalog_manager.cc:5495] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2). New cstate: current_term: 1 leader_uuid: "fe6985f2b40b403aa46d33e2a42309f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } health_report { overall_health: UNKNOWN } } }
I20260810 21:04:25.999323 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:25.995400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34830 (local address 127.15.37.2:46179)
0810 21:04:25.995676 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:25.995678 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:25.995685 (+ 7us) server_negotiation.cc:407] Connection header received
0810 21:04:25.995743 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:25.995744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:25.995766 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:25.995984 (+ 218us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:25.996249 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.997087 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.998233 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:25.998566 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:25.998643 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:25.998839 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:25.998997 (+ 158us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:25.999072 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:25.999126 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 21:04:25.999161 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":132,"threads_started":1}
I20260810 21:04:26.006348 19114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:26.002908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:37021 (local address 127.15.37.1:40485)
0810 21:04:26.002994 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:26.002996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:26.003229 (+ 233us) server_negotiation.cc:407] Connection header received
0810 21:04:26.003327 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:26.003328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:26.003340 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:26.003392 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:26.003637 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:26.004139 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:26.005533 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:26.005747 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:26.005828 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:26.006060 (+ 232us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:26.006108 (+ 48us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:26.006174 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:26.006232 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 21:04:26.006258 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 21:04:26.006505 19208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:26.002747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:40485 (local address 127.15.37.2:37021)
0810 21:04:26.003025 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:26.003042 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:26.003248 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:26.003391 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:26.003392 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:26.003394 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 21:04:26.003559 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:26.003561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:26.004238 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:26.004239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:26.005410 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:26.005414 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:26.005827 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:26.005828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:26.005943 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:26.005961 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 21:04:26.006176 (+ 215us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 21:04:26.006179 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:04:26.006229 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 21:04:26.006281 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":121,"threads_started":1}
I20260810 21:04:26.009140 18565 raft_consensus.cc:1261] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Refusing update from remote peer fe6985f2b40b403aa46d33e2a42309f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:26.009140 19013 raft_consensus.cc:1261] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Refusing update from remote peer fe6985f2b40b403aa46d33e2a42309f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:26.009559 19197 consensus_queue.cc:1035] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:26.009712 19136 consensus_queue.cc:1035] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:26.021396 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:26.018503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:46179 (local address 127.15.37.1:40385)
0810 21:04:26.018610 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:26.018623 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:26.018669 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:26.018861 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:26.018862 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:26.018864 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 21:04:26.018917 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:26.018918 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:26.019802 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:26.019804 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:26.020455 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:26.020458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:26.021007 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:26.021008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:26.021072 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:26.021086 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 21:04:26.021261 (+ 175us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 21:04:26.021262 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 21:04:26.021294 (+ 32us) client_negotiation.cc:240] Negotiation successful
0810 21:04:26.021337 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260810 21:04:26.021404 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:26.018595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:40385 (local address 127.15.37.2:46179)
0810 21:04:26.018638 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:26.018641 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:26.018651 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:04:26.018746 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:26.018747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:26.018760 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:26.018806 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:26.018972 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:26.019704 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:26.020623 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:26.020936 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:26.021011 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:26.021165 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:26.021203 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:26.021258 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:26.021298 (+ 40us) server_negotiation.cc:299] Negotiation successful
0810 21:04:26.021323 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260810 21:04:26.022100 19161 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 21:04:27.552626 18315 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:27.552740 18315 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52614:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:27.553627 18315 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785: Sending DeleteTablet for 3 replicas of tablet 3ec42d90fd0649cfacd44c9309fa0367
I20260810 21:04:27.553926 18534 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ec42d90fd0649cfacd44c9309fa0367 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:27 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34200
I20260810 21:04:27.553925 18737 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ec42d90fd0649cfacd44c9309fa0367 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:27 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34822
I20260810 21:04:27.553972 18983 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ec42d90fd0649cfacd44c9309fa0367 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:27 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:58784
I20260810 21:04:27.554266 19255 tablet_replica.cc:330] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566: stopping tablet replica
I20260810 21:04:27.554342 19255 raft_consensus.cc:2229] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:27.554384 19255 raft_consensus.cc:2258] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:27.554515 19254 tablet_replica.cc:330] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060: stopping tablet replica
I20260810 21:04:27.554592 19254 raft_consensus.cc:2229] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:27.554641 19254 raft_consensus.cc:2258] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:27.554872 19255 ts_tablet_manager.cc:1905] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:27.557142 19255 ts_tablet_manager.cc:1918] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 21:04:27.557255 19255 log.cc:1196] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/3ec42d90fd0649cfacd44c9309fa0367
I20260810 21:04:27.557575 19255 ts_tablet_manager.cc:1939] T 3ec42d90fd0649cfacd44c9309fa0367 P 40764c93e9094ebfa0654a2ef70f6566: Deleting consensus metadata
I20260810 21:04:27.557993 18291 catalog_manager.cc:4841] TS 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821): tablet 3ec42d90fd0649cfacd44c9309fa0367 (table test-table [id=26c7e95d64c248b49e82605a75ed383e]) successfully deleted
I20260810 21:04:27.558032 19254 ts_tablet_manager.cc:1905] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:27.559335 19254 ts_tablet_manager.cc:1918] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 21:04:27.559391 19254 log.cc:1196] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/wal/wals/3ec42d90fd0649cfacd44c9309fa0367
I20260810 21:04:27.559564 19254 ts_tablet_manager.cc:1939] T 3ec42d90fd0649cfacd44c9309fa0367 P 0586dd2d53ad46219281bda1ea2ba060: Deleting consensus metadata
I20260810 21:04:27.560020 18291 catalog_manager.cc:4841] TS 0586dd2d53ad46219281bda1ea2ba060 (127.15.37.1:40485): tablet 3ec42d90fd0649cfacd44c9309fa0367 (table test-table [id=26c7e95d64c248b49e82605a75ed383e]) successfully deleted
I20260810 21:04:27.560603 19253 tablet_replica.cc:330] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4: stopping tablet replica
I20260810 21:04:27.560669 19253 raft_consensus.cc:2229] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:04:27.560808 19253 raft_consensus.cc:2258] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:27.561257 19253 ts_tablet_manager.cc:1905] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:27.562928 19253 ts_tablet_manager.cc:1918] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 21:04:27.562981 19253 log.cc:1196] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/3ec42d90fd0649cfacd44c9309fa0367
I20260810 21:04:27.563244 19253 ts_tablet_manager.cc:1939] T 3ec42d90fd0649cfacd44c9309fa0367 P fe6985f2b40b403aa46d33e2a42309f4: Deleting consensus metadata
I20260810 21:04:27.563638 18295 catalog_manager.cc:4841] TS fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2:46179): tablet 3ec42d90fd0649cfacd44c9309fa0367 (table test-table [id=26c7e95d64c248b49e82605a75ed383e]) successfully deleted
Aug 10 21:04:27 dist-test-slave-jq4t krb5kdc[18243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395867, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 21:04:27 dist-test-slave-jq4t krb5kdc[18243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395867, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:27.584105 19266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:27.576648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52640 (local address 127.15.37.62:38457)
0810 21:04:27.576899 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:27.576901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:27.576929 (+ 28us) server_negotiation.cc:407] Connection header received
0810 21:04:27.576960 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:27.576961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:27.576973 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:27.577065 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:27.577635 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:27.578174 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:27.578945 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:27.579147 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:27.579200 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:27.581645 (+ 2445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:27.581646 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:27.581647 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:27.581654 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:27.583066 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:27.583401 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:27.583402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:27.583402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:27.583469 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:27.583639 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:27.583639 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:27.583640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:27.583750 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:27.583826 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:27.583952 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 21:04:27.584026 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":112,"threads_started":1}
I20260810 21:04:27.585952 18315 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:27.586187 18315 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:27.587766 18534 tablet_service.cc:1467] Processing CreateTablet for tablet bd4e50698f804c10818797ac953d349d (DEFAULT_TABLE table=test-table [id=b625606084774afebc949277d0ae9b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:27.587766 18737 tablet_service.cc:1467] Processing CreateTablet for tablet bd4e50698f804c10818797ac953d349d (DEFAULT_TABLE table=test-table [id=b625606084774afebc949277d0ae9b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:27.587776 18983 tablet_service.cc:1467] Processing CreateTablet for tablet bd4e50698f804c10818797ac953d349d (DEFAULT_TABLE table=test-table [id=b625606084774afebc949277d0ae9b93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:27.587929 18737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd4e50698f804c10818797ac953d349d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:27.587930 18534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd4e50698f804c10818797ac953d349d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:27.587942 18983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd4e50698f804c10818797ac953d349d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:27.589274 19269 tablet_bootstrap.cc:492] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566: Bootstrap starting.
I20260810 21:04:27.589694 19271 tablet_bootstrap.cc:492] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4: Bootstrap starting.
I20260810 21:04:27.589797 19269 tablet_bootstrap.cc:654] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:27.589789 19270 tablet_bootstrap.cc:492] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060: Bootstrap starting.
I20260810 21:04:27.590137 19271 tablet_bootstrap.cc:654] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:27.590168 19270 tablet_bootstrap.cc:654] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:27.590579 19269 tablet_bootstrap.cc:492] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566: No bootstrap required, opened a new log
I20260810 21:04:27.590654 19269 ts_tablet_manager.cc:1397] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:27.590837 19271 tablet_bootstrap.cc:492] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4: No bootstrap required, opened a new log
I20260810 21:04:27.590884 19270 tablet_bootstrap.cc:492] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060: No bootstrap required, opened a new log
I20260810 21:04:27.590901 19271 ts_tablet_manager.cc:1397] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:27.590930 19270 ts_tablet_manager.cc:1397] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:27.590972 19269 raft_consensus.cc:348] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.591060 19269 raft_consensus.cc:374] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:27.591089 19269 raft_consensus.cc:729] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40764c93e9094ebfa0654a2ef70f6566, State: Initialized, Role: FOLLOWER
I20260810 21:04:27.591078 19271 raft_consensus.cc:348] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.591154 19269 consensus_queue.cc:260] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.591187 19271 raft_consensus.cc:374] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:27.591208 19271 raft_consensus.cc:729] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6985f2b40b403aa46d33e2a42309f4, State: Initialized, Role: FOLLOWER
I20260810 21:04:27.591255 19271 consensus_queue.cc:260] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.591250 19270 raft_consensus.cc:348] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.591322 19270 raft_consensus.cc:374] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:27.591320 19269 ts_tablet_manager.cc:1428] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:27.591346 19270 raft_consensus.cc:729] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0586dd2d53ad46219281bda1ea2ba060, State: Initialized, Role: FOLLOWER
I20260810 21:04:27.591358 19271 ts_tablet_manager.cc:1428] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 21:04:27.591413 19270 consensus_queue.cc:260] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.591528 19270 ts_tablet_manager.cc:1428] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:27.735080 19216 raft_consensus.cc:482] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:27.735209 19216 raft_consensus.cc:504] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.735414 19216 leader_election.cc:288] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0586dd2d53ad46219281bda1ea2ba060 (127.15.37.1:40485), 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821)
I20260810 21:04:27.735689 18565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd4e50698f804c10818797ac953d349d" candidate_uuid: "fe6985f2b40b403aa46d33e2a42309f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0586dd2d53ad46219281bda1ea2ba060" is_pre_election: true
I20260810 21:04:27.735809 18565 raft_consensus.cc:2454] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6985f2b40b403aa46d33e2a42309f4 in term 0.
I20260810 21:04:27.735746 19012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd4e50698f804c10818797ac953d349d" candidate_uuid: "fe6985f2b40b403aa46d33e2a42309f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40764c93e9094ebfa0654a2ef70f6566" is_pre_election: true
I20260810 21:04:27.735879 19012 raft_consensus.cc:2454] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe6985f2b40b403aa46d33e2a42309f4 in term 0.
I20260810 21:04:27.736028 18679 leader_election.cc:302] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0586dd2d53ad46219281bda1ea2ba060, fe6985f2b40b403aa46d33e2a42309f4; no voters:
I20260810 21:04:27.736181 19216 raft_consensus.cc:2781] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:27.736246 19216 raft_consensus.cc:482] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:27.736263 19216 raft_consensus.cc:3037] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:27.737128 19216 raft_consensus.cc:504] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.737277 19216 leader_election.cc:288] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [CANDIDATE]: Term 1 election: Requested vote from peers 0586dd2d53ad46219281bda1ea2ba060 (127.15.37.1:40485), 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821)
I20260810 21:04:27.737495 18565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd4e50698f804c10818797ac953d349d" candidate_uuid: "fe6985f2b40b403aa46d33e2a42309f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0586dd2d53ad46219281bda1ea2ba060"
I20260810 21:04:27.737533 19012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd4e50698f804c10818797ac953d349d" candidate_uuid: "fe6985f2b40b403aa46d33e2a42309f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40764c93e9094ebfa0654a2ef70f6566"
I20260810 21:04:27.737607 19012 raft_consensus.cc:3037] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:27.737601 18565 raft_consensus.cc:3037] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:27.738270 18565 raft_consensus.cc:2454] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6985f2b40b403aa46d33e2a42309f4 in term 1.
I20260810 21:04:27.738345 19012 raft_consensus.cc:2454] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe6985f2b40b403aa46d33e2a42309f4 in term 1.
I20260810 21:04:27.738502 18679 leader_election.cc:302] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0586dd2d53ad46219281bda1ea2ba060, fe6985f2b40b403aa46d33e2a42309f4; no voters:
I20260810 21:04:27.738617 19216 raft_consensus.cc:2781] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:27.738684 19216 raft_consensus.cc:686] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [term 1 LEADER]: Becoming Leader. State: Replica: fe6985f2b40b403aa46d33e2a42309f4, State: Running, Role: LEADER
I20260810 21:04:27.738749 19216 consensus_queue.cc:237] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.739409 18315 catalog_manager.cc:5495] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2). New cstate: current_term: 1 leader_uuid: "fe6985f2b40b403aa46d33e2a42309f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } health_report { overall_health: UNKNOWN } } }
I20260810 21:04:27.778229 19283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:27.775668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34834 (local address 127.15.37.2:46179)
0810 21:04:27.775859 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:27.775862 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:27.775869 (+ 7us) server_negotiation.cc:407] Connection header received
0810 21:04:27.775889 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:27.775889 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:27.775899 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:27.775976 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:27.776120 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:27.776718 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:27.777508 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:27.777716 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:27.777794 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:27.777930 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:27.777971 (+ 41us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:27.778025 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:27.778105 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 21:04:27.778128 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":101,"threads_started":1}
I20260810 21:04:27.780732 18565 raft_consensus.cc:1261] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Refusing update from remote peer fe6985f2b40b403aa46d33e2a42309f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:27.780730 19012 raft_consensus.cc:1261] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Refusing update from remote peer fe6985f2b40b403aa46d33e2a42309f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:27.781034 19240 consensus_queue.cc:1035] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:27.781172 19216 consensus_queue.cc:1035] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:27.792021 18315 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:27.792148 18315 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:27.792912 18315 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785: Sending DeleteTablet for 3 replicas of tablet bd4e50698f804c10818797ac953d349d
I20260810 21:04:27.793171 18737 tablet_service.cc:1514] Processing DeleteTablet for tablet bd4e50698f804c10818797ac953d349d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:27 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34822
I20260810 21:04:27.793164 18534 tablet_service.cc:1514] Processing DeleteTablet for tablet bd4e50698f804c10818797ac953d349d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:27 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34200
I20260810 21:04:27.793205 18983 tablet_service.cc:1514] Processing DeleteTablet for tablet bd4e50698f804c10818797ac953d349d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:27 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:58784
I20260810 21:04:27.793295 19255 tablet_replica.cc:330] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566: stopping tablet replica
I20260810 21:04:27.793304 19253 tablet_replica.cc:330] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4: stopping tablet replica
I20260810 21:04:27.793357 19255 raft_consensus.cc:2229] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:27.793368 19253 raft_consensus.cc:2229] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:04:27.793403 19255 raft_consensus.cc:2258] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:27.793429 19253 raft_consensus.cc:2258] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:27.793517 19254 tablet_replica.cc:330] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060: stopping tablet replica
I20260810 21:04:27.793592 19254 raft_consensus.cc:2229] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:27.793645 19254 raft_consensus.cc:2258] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:27.793634 18315 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:27.793787 18315 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:27.793817 19255 ts_tablet_manager.cc:1905] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:27.794091 19253 ts_tablet_manager.cc:1905] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:27.795729 19254 ts_tablet_manager.cc:1905] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:27.795746 19255 ts_tablet_manager.cc:1918] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:27.795746 19253 ts_tablet_manager.cc:1918] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:27.795801 19255 log.cc:1196] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/bd4e50698f804c10818797ac953d349d
I20260810 21:04:27.795801 19253 log.cc:1196] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/bd4e50698f804c10818797ac953d349d
I20260810 21:04:27.796046 19253 ts_tablet_manager.cc:1939] T bd4e50698f804c10818797ac953d349d P fe6985f2b40b403aa46d33e2a42309f4: Deleting consensus metadata
I20260810 21:04:27.796056 19255 ts_tablet_manager.cc:1939] T bd4e50698f804c10818797ac953d349d P 40764c93e9094ebfa0654a2ef70f6566: Deleting consensus metadata
I20260810 21:04:27.796550 18295 catalog_manager.cc:4841] TS fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2:46179): tablet bd4e50698f804c10818797ac953d349d (table test-table [id=b625606084774afebc949277d0ae9b93]) successfully deleted
I20260810 21:04:27.796869 18737 tablet_service.cc:1467] Processing CreateTablet for tablet 82883b4fa792430aaf2009478d2141c9 (DEFAULT_TABLE table=test-table [id=628e0933a48e49dc95655d5e9474a46c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:27.796869 18534 tablet_service.cc:1467] Processing CreateTablet for tablet 82883b4fa792430aaf2009478d2141c9 (DEFAULT_TABLE table=test-table [id=628e0933a48e49dc95655d5e9474a46c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:27.796988 18534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82883b4fa792430aaf2009478d2141c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:27.797070 18737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82883b4fa792430aaf2009478d2141c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:27.797443 19254 ts_tablet_manager.cc:1918] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:27.797534 19254 log.cc:1196] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-0/wal/wals/bd4e50698f804c10818797ac953d349d
I20260810 21:04:27.797756 19254 ts_tablet_manager.cc:1939] T bd4e50698f804c10818797ac953d349d P 0586dd2d53ad46219281bda1ea2ba060: Deleting consensus metadata
I20260810 21:04:27.798208 18983 tablet_service.cc:1467] Processing CreateTablet for tablet 82883b4fa792430aaf2009478d2141c9 (DEFAULT_TABLE table=test-table [id=628e0933a48e49dc95655d5e9474a46c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:27.798324 18983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82883b4fa792430aaf2009478d2141c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:27.798380 18291 catalog_manager.cc:4841] TS 0586dd2d53ad46219281bda1ea2ba060 (127.15.37.1:40485): tablet bd4e50698f804c10818797ac953d349d (table test-table [id=b625606084774afebc949277d0ae9b93]) successfully deleted
I20260810 21:04:27.798448 18291 catalog_manager.cc:4841] TS 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821): tablet bd4e50698f804c10818797ac953d349d (table test-table [id=b625606084774afebc949277d0ae9b93]) successfully deleted
I20260810 21:04:27.798610 19271 tablet_bootstrap.cc:492] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4: Bootstrap starting.
I20260810 21:04:27.798954 19271 tablet_bootstrap.cc:654] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:27.799762 19271 tablet_bootstrap.cc:492] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4: No bootstrap required, opened a new log
I20260810 21:04:27.799813 19271 ts_tablet_manager.cc:1397] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:27.799860 19270 tablet_bootstrap.cc:492] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060: Bootstrap starting.
I20260810 21:04:27.799841 19269 tablet_bootstrap.cc:492] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566: Bootstrap starting.
I20260810 21:04:27.799953 19271 raft_consensus.cc:348] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.800038 19271 raft_consensus.cc:374] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:27.800064 19271 raft_consensus.cc:729] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe6985f2b40b403aa46d33e2a42309f4, State: Initialized, Role: FOLLOWER
I20260810 21:04:27.800109 19271 consensus_queue.cc:260] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.800202 19271 ts_tablet_manager.cc:1428] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:27.800278 19270 tablet_bootstrap.cc:654] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:27.800441 19269 tablet_bootstrap.cc:654] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:27.801016 19270 tablet_bootstrap.cc:492] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060: No bootstrap required, opened a new log
I20260810 21:04:27.801086 19270 ts_tablet_manager.cc:1397] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:27.801211 19270 raft_consensus.cc:348] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.801308 19270 raft_consensus.cc:374] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:27.801338 19270 raft_consensus.cc:729] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0586dd2d53ad46219281bda1ea2ba060, State: Initialized, Role: FOLLOWER
I20260810 21:04:27.801383 19270 consensus_queue.cc:260] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.801496 19270 ts_tablet_manager.cc:1428] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 21:04:27.801898 19269 tablet_bootstrap.cc:492] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566: No bootstrap required, opened a new log
I20260810 21:04:27.801959 19269 ts_tablet_manager.cc:1397] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:04:27.802389 19269 raft_consensus.cc:348] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.802488 19269 raft_consensus.cc:374] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:27.802515 19269 raft_consensus.cc:729] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40764c93e9094ebfa0654a2ef70f6566, State: Initialized, Role: FOLLOWER
I20260810 21:04:27.802577 19269 consensus_queue.cc:260] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.802675 19269 ts_tablet_manager.cc:1428] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:27.905133 19221 raft_consensus.cc:482] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:27.905251 19221 raft_consensus.cc:504] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.905524 19221 leader_election.cc:288] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2:46179), 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821)
I20260810 21:04:27.905834 18792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82883b4fa792430aaf2009478d2141c9" candidate_uuid: "0586dd2d53ad46219281bda1ea2ba060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6985f2b40b403aa46d33e2a42309f4" is_pre_election: true
I20260810 21:04:27.905864 19012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82883b4fa792430aaf2009478d2141c9" candidate_uuid: "0586dd2d53ad46219281bda1ea2ba060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40764c93e9094ebfa0654a2ef70f6566" is_pre_election: true
I20260810 21:04:27.905967 18792 raft_consensus.cc:2454] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0586dd2d53ad46219281bda1ea2ba060 in term 0.
I20260810 21:04:27.905967 19012 raft_consensus.cc:2454] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0586dd2d53ad46219281bda1ea2ba060 in term 0.
I20260810 21:04:27.906150 18451 leader_election.cc:302] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0586dd2d53ad46219281bda1ea2ba060, 40764c93e9094ebfa0654a2ef70f6566; no voters:
I20260810 21:04:27.906278 19221 raft_consensus.cc:2781] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:27.906322 19221 raft_consensus.cc:482] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:27.906359 19221 raft_consensus.cc:3037] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:27.907065 19221 raft_consensus.cc:504] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.907218 19221 leader_election.cc:288] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [CANDIDATE]: Term 1 election: Requested vote from peers fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2:46179), 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821)
I20260810 21:04:27.907351 18792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82883b4fa792430aaf2009478d2141c9" candidate_uuid: "0586dd2d53ad46219281bda1ea2ba060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe6985f2b40b403aa46d33e2a42309f4"
I20260810 21:04:27.907402 19012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82883b4fa792430aaf2009478d2141c9" candidate_uuid: "0586dd2d53ad46219281bda1ea2ba060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40764c93e9094ebfa0654a2ef70f6566"
I20260810 21:04:27.907445 18792 raft_consensus.cc:3037] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:27.907480 19012 raft_consensus.cc:3037] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:27.908293 18792 raft_consensus.cc:2454] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0586dd2d53ad46219281bda1ea2ba060 in term 1.
I20260810 21:04:27.908388 19012 raft_consensus.cc:2454] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0586dd2d53ad46219281bda1ea2ba060 in term 1.
I20260810 21:04:27.908563 18455 leader_election.cc:302] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0586dd2d53ad46219281bda1ea2ba060, fe6985f2b40b403aa46d33e2a42309f4; no voters:
I20260810 21:04:27.908664 19221 raft_consensus.cc:2781] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:27.908763 19221 raft_consensus.cc:686] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [term 1 LEADER]: Becoming Leader. State: Replica: 0586dd2d53ad46219281bda1ea2ba060, State: Running, Role: LEADER
I20260810 21:04:27.908829 19221 consensus_queue.cc:237] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } }
I20260810 21:04:27.909518 18316 catalog_manager.cc:5495] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0586dd2d53ad46219281bda1ea2ba060 (127.15.37.1). New cstate: current_term: 1 leader_uuid: "0586dd2d53ad46219281bda1ea2ba060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0586dd2d53ad46219281bda1ea2ba060" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40485 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 } health_report { overall_health: UNKNOWN } } }
I20260810 21:04:27.923403 19301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:27.920888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34234 (local address 127.15.37.1:40485)
0810 21:04:27.921081 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:27.921082 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:27.921089 (+ 7us) server_negotiation.cc:407] Connection header received
0810 21:04:27.921109 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:27.921109 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:27.921119 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:27.921195 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:27.921353 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:27.921867 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:27.922619 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:27.922839 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:27.922919 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:27.923086 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:27.923130 (+ 44us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:27.923193 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:27.923259 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 21:04:27.923285 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":113,"threads_started":1}
I20260810 21:04:27.926424 19012 raft_consensus.cc:1261] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Refusing update from remote peer 0586dd2d53ad46219281bda1ea2ba060: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:27.926438 18792 raft_consensus.cc:1261] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Refusing update from remote peer 0586dd2d53ad46219281bda1ea2ba060: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:27.926678 19300 consensus_queue.cc:1035] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40764c93e9094ebfa0654a2ef70f6566" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 33821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:27.926831 19229 consensus_queue.cc:1035] T 82883b4fa792430aaf2009478d2141c9 P 0586dd2d53ad46219281bda1ea2ba060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe6985f2b40b403aa46d33e2a42309f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 21:04:27.931529 19218 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 21:04:29.450732 18316 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:29.450879 18316 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:29.451905 18316 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 976c41c2ae174cd7a135110aea919785: Sending DeleteTablet for 3 replicas of tablet 82883b4fa792430aaf2009478d2141c9
I20260810 21:04:29.452229 18534 tablet_service.cc:1514] Processing DeleteTablet for tablet 82883b4fa792430aaf2009478d2141c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:29 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34200
I20260810 21:04:29.452229 18737 tablet_service.cc:1514] Processing DeleteTablet for tablet 82883b4fa792430aaf2009478d2141c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:29 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34822
I20260810 21:04:29.452322 18983 tablet_service.cc:1514] Processing DeleteTablet for tablet 82883b4fa792430aaf2009478d2141c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:29 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:58784
I20260810 21:04:29.452379 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 18428
I20260810 21:04:29.462383 19338 tablet_replica.cc:330] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566: stopping tablet replica
I20260810 21:04:29.462518 19338 raft_consensus.cc:2229] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:29.462574 19338 raft_consensus.cc:2258] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:29.462949 19338 ts_tablet_manager.cc:1905] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:29.464689 19337 tablet_replica.cc:330] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4: stopping tablet replica
I20260810 21:04:29.464797 19337 raft_consensus.cc:2229] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:29.464861 19337 raft_consensus.cc:2258] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:29.465085 19338 ts_tablet_manager.cc:1918] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 21:04:29.465165 19338 log.cc:1196] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/82883b4fa792430aaf2009478d2141c9
I20260810 21:04:29.465232 19337 ts_tablet_manager.cc:1905] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:29.465492 19338 ts_tablet_manager.cc:1939] T 82883b4fa792430aaf2009478d2141c9 P 40764c93e9094ebfa0654a2ef70f6566: Deleting consensus metadata
I20260810 21:04:29.466014 18291 catalog_manager.cc:4841] TS 40764c93e9094ebfa0654a2ef70f6566 (127.15.37.3:33821): tablet 82883b4fa792430aaf2009478d2141c9 (table test-table [id=628e0933a48e49dc95655d5e9474a46c]) successfully deleted
I20260810 21:04:29.466856 19337 ts_tablet_manager.cc:1918] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 21:04:29.466939 19337 log.cc:1196] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/82883b4fa792430aaf2009478d2141c9
I20260810 21:04:29.467190 19337 ts_tablet_manager.cc:1939] T 82883b4fa792430aaf2009478d2141c9 P fe6985f2b40b403aa46d33e2a42309f4: Deleting consensus metadata
I20260810 21:04:29.467618 18295 catalog_manager.cc:4841] TS fe6985f2b40b403aa46d33e2a42309f4 (127.15.37.2:46179): tablet 82883b4fa792430aaf2009478d2141c9 (table test-table [id=628e0933a48e49dc95655d5e9474a46c]) successfully deleted
W20260810 21:04:29.469518 18291 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:40485 (error 108)
I20260810 21:04:29.469769 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 18647
I20260810 21:04:29.479499 19340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:29.478814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:40485 (local address 127.0.0.1:34248)
0810 21:04:29.479356 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:29.479428 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:40485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":115,"threads_started":1}
W20260810 21:04:29.479700 18291 catalog_manager.cc:4584] TS 0586dd2d53ad46219281bda1ea2ba060 (127.15.37.1:40485): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 82883b4fa792430aaf2009478d2141c9: Network error: Client connection negotiation failed: client connection to 127.15.37.1:40485: connect: Connection refused (error 111)
I20260810 21:04:29.487294 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 18885
I20260810 21:04:29.502431 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 18263
2026-08-10T21:04:29Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6306 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:04:29 dist-test-slave-jq4t krb5kdc[19346](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:04:29 dist-test-slave-jq4t krb5kdc[19346](info): set up 2 sockets
Aug 10 21:04:29 dist-test-slave-jq4t krb5kdc[19346](info): commencing operation
krb5kdc: starting...
W20260810 21:04:30.795019 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:04:30 dist-test-slave-jq4t krb5kdc[19346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:04:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:04:30.932008 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:33079
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:37283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:33079
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:31.018745 19372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:31.018996 19372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:31.019037 19372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:31.020255 19372 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:31.020332 19372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:31.020357 19372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:31.020390 19372 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:31.020416 19372 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:31.021977 19372 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:33079
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:33079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:31.022281 19372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:31.022540 19372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:31.027683 19377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:31.027715 19378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:31.027776 19372 server_base.cc:1034] running on GCE node
W20260810 21:04:31.027714 19380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:31.028298 19372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:31.028640 19372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:31.029793 19372 hybrid_clock.cc:648] HybridClock initialized: now 1786395871029780 us; error 35 us; skew 500 ppm
Aug 10 21:04:31 dist-test-slave-jq4t krb5kdc[19346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395871, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:31.035732 19372 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:04:31.036212 19372 webserver.cc:460] Webserver started at http://127.15.37.62:39565/ using document root <none> and password file <none>
I20260810 21:04:31.036454 19372 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:31.036561 19372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:31.036720 19372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:31.037899 19372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "abf2826b6b074456909674150ef4ebc7"
format_stamp: "Formatted at 2026-08-10 21:04:31 on dist-test-slave-jq4t"
server_key: "7061c6bad4edc667a26de9e88f6154e3"
server_key_iv: "f9c971ba1999140801ce83585bde6185"
server_key_version: "encryptionkey@0"
I20260810 21:04:31.038287 19372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "abf2826b6b074456909674150ef4ebc7"
format_stamp: "Formatted at 2026-08-10 21:04:31 on dist-test-slave-jq4t"
server_key: "7061c6bad4edc667a26de9e88f6154e3"
server_key_iv: "f9c971ba1999140801ce83585bde6185"
server_key_version: "encryptionkey@0"
I20260810 21:04:31.039716 19372 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:31.040561 19391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:31.040745 19372 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:31.040850 19372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "abf2826b6b074456909674150ef4ebc7"
format_stamp: "Formatted at 2026-08-10 21:04:31 on dist-test-slave-jq4t"
server_key: "7061c6bad4edc667a26de9e88f6154e3"
server_key_iv: "f9c971ba1999140801ce83585bde6185"
server_key_version: "encryptionkey@0"
I20260810 21:04:31.040934 19372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:31.054327 19372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:31.056691 19372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:31.056872 19372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:31.061219 19372 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:33079
I20260810 21:04:31.061257 19469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:33079 every 8 connection(s)
I20260810 21:04:31.061673 19372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:31.062639 19470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:31.065184 19470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7: Bootstrap starting.
I20260810 21:04:31.065784 19470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:31.066045 19470 log.cc:824] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:31.066743 19470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7: No bootstrap required, opened a new log
I20260810 21:04:31.068285 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 19372
I20260810 21:04:31.068392 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:31.068363 19470 raft_consensus.cc:348] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf2826b6b074456909674150ef4ebc7" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 33079 } }
I20260810 21:04:31.068608 19470 raft_consensus.cc:374] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:31.068650 15508 external_mini_cluster.cc:1428] Setting key 5a4bec90fec7ec4d8847c3c2a54b7ec9
I20260810 21:04:31.068670 19470 raft_consensus.cc:729] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf2826b6b074456909674150ef4ebc7, State: Initialized, Role: FOLLOWER
I20260810 21:04:31.068858 19470 consensus_queue.cc:260] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf2826b6b074456909674150ef4ebc7" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 33079 } }
I20260810 21:04:31.068949 19470 raft_consensus.cc:388] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:31.068974 19470 raft_consensus.cc:482] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:31.069044 19470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:31.069736 19470 raft_consensus.cc:504] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf2826b6b074456909674150ef4ebc7" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 33079 } }
I20260810 21:04:31.069869 19470 leader_election.cc:302] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abf2826b6b074456909674150ef4ebc7; no voters:
I20260810 21:04:31.070051 19470 leader_election.cc:288] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:31.070077 19480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:31.070282 19480 raft_consensus.cc:686] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [term 1 LEADER]: Becoming Leader. State: Replica: abf2826b6b074456909674150ef4ebc7, State: Running, Role: LEADER
I20260810 21:04:31.070315 19470 sys_catalog.cc:564] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:31.070382 19480 consensus_queue.cc:237] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf2826b6b074456909674150ef4ebc7" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 33079 } }
I20260810 21:04:31.070776 19480 sys_catalog.cc:455] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abf2826b6b074456909674150ef4ebc7. Latest consensus state: current_term: 1 leader_uuid: "abf2826b6b074456909674150ef4ebc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf2826b6b074456909674150ef4ebc7" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 33079 } } }
I20260810 21:04:31.070787 19481 sys_catalog.cc:455] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abf2826b6b074456909674150ef4ebc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf2826b6b074456909674150ef4ebc7" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 33079 } } }
I20260810 21:04:31.070958 19480 sys_catalog.cc:458] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:31.070966 19481 sys_catalog.cc:458] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:31.071398 19491 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:31.072003 19491 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:31.076501 19491 catalog_manager.cc:1347] Generated new cluster ID: 2ab931a469564f1bba8181706b24cd55
I20260810 21:04:31.076567 19491 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:04:31 dist-test-slave-jq4t krb5kdc[19346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:31.082448 19478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:31.069405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50158 (local address 127.15.37.62:33079)
0810 21:04:31.069873 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:31.069883 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:31.069922 (+ 39us) server_negotiation.cc:407] Connection header received
0810 21:04:31.070065 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:31.070074 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:31.070143 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:31.071268 (+ 1125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:31.071407 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.073200 (+ 1793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.073976 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.074625 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.074742 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:31.077659 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:31.077665 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:31.077666 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:31.077679 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:31.080608 (+ 2929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:31.081074 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:31.081078 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:31.081079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:31.081210 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:31.081451 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:31.081452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:31.081452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:31.081787 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:31.081952 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:31.082070 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 21:04:31.082214 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":370,"threads_started":1}
I20260810 21:04:31.095185 19491 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:31.095786 19491 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:31.098320 19491 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abf2826b6b074456909674150ef4ebc7: Generated new TSK 0
I20260810 21:04:31.098552 19491 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:04:31.129827 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:33079
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:37283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:31.217253 19514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:31.217510 19514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:31.217538 19514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:31.218838 19514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:31.218899 19514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:31.218930 19514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:04:31.220618 19514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:33079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:31.220927 19514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:31.221207 19514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:31.226831 19523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:31.226821 19521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:31.226817 19520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:31.227128 19514 server_base.cc:1034] running on GCE node
I20260810 21:04:31.227357 19514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:31.227623 19514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:31.228768 19514 hybrid_clock.cc:648] HybridClock initialized: now 1786395871228745 us; error 40 us; skew 500 ppm
Aug 10 21:04:31 dist-test-slave-jq4t krb5kdc[19346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395871, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:31.231446 19514 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:04:31.231865 19514 webserver.cc:460] Webserver started at http://127.15.37.1:45573/ using document root <none> and password file <none>
I20260810 21:04:31.232076 19514 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:31.232118 19514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:31.232213 19514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:31.233332 19514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "0296636b1dc449f89f14bd710d72de8d"
format_stamp: "Formatted at 2026-08-10 21:04:31 on dist-test-slave-jq4t"
server_key: "aae06466d10e35821e5ebdbfb02379b3"
server_key_iv: "d6d14aefbd34e80c56e9be035e559912"
server_key_version: "encryptionkey@0"
I20260810 21:04:31.233655 19514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "0296636b1dc449f89f14bd710d72de8d"
format_stamp: "Formatted at 2026-08-10 21:04:31 on dist-test-slave-jq4t"
server_key: "aae06466d10e35821e5ebdbfb02379b3"
server_key_iv: "d6d14aefbd34e80c56e9be035e559912"
server_key_version: "encryptionkey@0"
I20260810 21:04:31.235072 19514 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 21:04:31.235795 19535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:31.236089 19514 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:31.236171 19514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "0296636b1dc449f89f14bd710d72de8d"
format_stamp: "Formatted at 2026-08-10 21:04:31 on dist-test-slave-jq4t"
server_key: "aae06466d10e35821e5ebdbfb02379b3"
server_key_iv: "d6d14aefbd34e80c56e9be035e559912"
server_key_version: "encryptionkey@0"
I20260810 21:04:31.236225 19514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:31.247618 19514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:31.250036 19514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:31.250165 19514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:31.250370 19514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:31.250718 19514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:31.250754 19514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:31.250778 19514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:31.250839 19514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:31.256839 19514 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:45045
I20260810 21:04:31.256965 19713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:45045 every 8 connection(s)
I20260810 21:04:31.257329 19514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
Aug 10 21:04:31 dist-test-slave-jq4t krb5kdc[19346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395871, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:31.266603 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 19514
I20260810 21:04:31.266695 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:04:31.266880 15508 external_mini_cluster.cc:1428] Setting key 80ca4e4cfb241fa8347497959a095399
I20260810 21:04:31.267648 19478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:31.258183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:37349 (local address 127.15.37.62:33079)
0810 21:04:31.258262 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:31.258265 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:31.258488 (+ 223us) server_negotiation.cc:407] Connection header received
0810 21:04:31.259085 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:31.259087 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:31.259105 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:31.259158 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:31.260188 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.260807 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.261847 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.262060 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.262141 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:31.264402 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:31.264404 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:31.264404 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:31.264412 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:31.265927 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:31.266364 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:31.266365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:31.266365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:31.266439 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:31.266825 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:31.266827 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:31.266827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:31.266982 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:31.267084 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:31.267437 (+ 353us) server_negotiation.cc:299] Negotiation successful
0810 21:04:31.267539 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 21:04:31.267969 19717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:31.258164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:33079 (local address 127.15.37.1:37349)
0810 21:04:31.258329 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:31.258381 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:31.258951 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:31.259234 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:31.259238 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:31.259846 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:31.260066 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:31.260071 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.260918 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.260919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:31.261745 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:31.261747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.262153 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.262155 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:31.262296 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:31.262885 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:31.262900 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:31.264290 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:31.266031 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:31.266039 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:31.266042 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:31.266285 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:31.266538 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:31.266539 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:31.266540 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:31.266691 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:31.267101 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:31.267108 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:31.267286 (+ 178us) client_negotiation.cc:769] Sending connection context
0810 21:04:31.267399 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 21:04:31.267577 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":79,"threads_started":1}
I20260810 21:04:31.268644 19714 heartbeater.cc:347] Connected to a master server at 127.15.37.62:33079
I20260810 21:04:31.268760 19714 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:31.268980 19714 heartbeater.cc:511] Master 127.15.37.62:33079 requested a full tablet report, sending...
I20260810 21:04:31.269590 19415 ts_manager.cc:194] Registered new tserver with Master: 0296636b1dc449f89f14bd710d72de8d (127.15.37.1:45045)
I20260810 21:04:31.270305 19415 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:37349
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:04:31.295981 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:33079
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:37283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:31.384927 19720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:31.385200 19720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:31.385241 19720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:31.387009 19720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:31.387092 19720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:31.387142 19720 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:04:31.389189 19720 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:33079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:31.389498 19720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:31.389711 19720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:31.395279 19727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:31.395238 19731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:31.395239 19728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:31.395447 19720 server_base.cc:1034] running on GCE node
I20260810 21:04:31.395750 19720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:31.396054 19720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:31.397238 19720 hybrid_clock.cc:648] HybridClock initialized: now 1786395871397214 us; error 40 us; skew 500 ppm
Aug 10 21:04:31 dist-test-slave-jq4t krb5kdc[19346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395871, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:31.400010 19720 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:04:31.400558 19720 webserver.cc:460] Webserver started at http://127.15.37.2:40139/ using document root <none> and password file <none>
I20260810 21:04:31.400795 19720 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:31.400842 19720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:31.400951 19720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:31.402047 19720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "1951ad19eac945bdb2cab09472b0cd70"
format_stamp: "Formatted at 2026-08-10 21:04:31 on dist-test-slave-jq4t"
server_key: "8eee31c98dd3a533f7195a00e6b520cf"
server_key_iv: "1be745606cc60d9b02c66c8bd3af2a90"
server_key_version: "encryptionkey@0"
I20260810 21:04:31.402384 19720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "1951ad19eac945bdb2cab09472b0cd70"
format_stamp: "Formatted at 2026-08-10 21:04:31 on dist-test-slave-jq4t"
server_key: "8eee31c98dd3a533f7195a00e6b520cf"
server_key_iv: "1be745606cc60d9b02c66c8bd3af2a90"
server_key_version: "encryptionkey@0"
I20260810 21:04:31.403753 19720 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:04:31.404618 19743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:31.404819 19720 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:31.404927 19720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "1951ad19eac945bdb2cab09472b0cd70"
format_stamp: "Formatted at 2026-08-10 21:04:31 on dist-test-slave-jq4t"
server_key: "8eee31c98dd3a533f7195a00e6b520cf"
server_key_iv: "1be745606cc60d9b02c66c8bd3af2a90"
server_key_version: "encryptionkey@0"
I20260810 21:04:31.404990 19720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:31.423596 19720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:31.425952 19720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:31.426084 19720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:31.426297 19720 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:31.426642 19720 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:31.426679 19720 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:31.426703 19720 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:31.426748 19720 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:31.432801 19720 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:43677
I20260810 21:04:31.432957 19931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:43677 every 8 connection(s)
I20260810 21:04:31.433238 19720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
Aug 10 21:04:31 dist-test-slave-jq4t krb5kdc[19346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395871, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:31.442407 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 19720
I20260810 21:04:31.442528 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:04:31.442773 15508 external_mini_cluster.cc:1428] Setting key a4c41be3a7f98f19dd33702acc9f0ae5
I20260810 21:04:31.443259 19478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:31.434096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:55287 (local address 127.15.37.62:33079)
0810 21:04:31.434146 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:31.434149 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:31.434422 (+ 273us) server_negotiation.cc:407] Connection header received
0810 21:04:31.434932 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:31.434933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:31.434943 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:31.435002 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:31.435988 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.436561 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.437615 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.437816 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.437902 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:31.440210 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:31.440212 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:31.440212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:31.440220 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:31.441598 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:31.442033 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:31.442034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:31.442035 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:31.442092 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:31.442442 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:31.442443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:31.442443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:31.442606 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:31.442660 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:31.443028 (+ 368us) server_negotiation.cc:299] Negotiation successful
0810 21:04:31.443130 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 21:04:31.443531 19939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:31.434053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:33079 (local address 127.15.37.2:55287)
0810 21:04:31.434280 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:31.434324 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:31.434837 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:31.435093 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:31.435096 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:31.435695 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:31.435904 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:31.435909 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.436661 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.436663 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:31.437510 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:31.437513 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.437911 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.437912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:31.438022 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:31.438627 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:31.438636 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:31.440110 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:31.441687 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:31.441694 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:31.441696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:31.441950 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:31.442182 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:31.442183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:31.442183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:31.442368 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:31.442662 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:31.442669 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:31.442864 (+ 195us) client_negotiation.cc:769] Sending connection context
0810 21:04:31.442994 (+ 130us) client_negotiation.cc:240] Negotiation successful
0810 21:04:31.443213 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":138,"threads_started":1}
I20260810 21:04:31.444283 19934 heartbeater.cc:347] Connected to a master server at 127.15.37.62:33079
I20260810 21:04:31.444422 19934 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:31.444644 19934 heartbeater.cc:511] Master 127.15.37.62:33079 requested a full tablet report, sending...
I20260810 21:04:31.445092 19415 ts_manager.cc:194] Registered new tserver with Master: 1951ad19eac945bdb2cab09472b0cd70 (127.15.37.2:43677)
I20260810 21:04:31.445607 19415 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:55287
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:04:31.471500 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:33079
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:37283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:31.559531 19943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:31.559804 19943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:31.559849 19943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:31.561160 19943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:31.561231 19943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:31.561278 19943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:04:31.562800 19943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:33079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:31.563084 19943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:31.563336 19943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:31.568637 19952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:31.568730 19943 server_base.cc:1034] running on GCE node
W20260810 21:04:31.568626 19953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:31.568626 19955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:31.569052 19943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:31.569371 19943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:31.570556 19943 hybrid_clock.cc:648] HybridClock initialized: now 1786395871570540 us; error 46 us; skew 500 ppm
Aug 10 21:04:31 dist-test-slave-jq4t krb5kdc[19346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395871, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:31.573657 19943 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:04:31.574136 19943 webserver.cc:460] Webserver started at http://127.15.37.3:38087/ using document root <none> and password file <none>
I20260810 21:04:31.574388 19943 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:31.574460 19943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:31.574623 19943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:31.575721 19943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "8e1da9a5ec66462596f57dd8e6987e28"
format_stamp: "Formatted at 2026-08-10 21:04:31 on dist-test-slave-jq4t"
server_key: "0df70cb8b821e1a5724f69092c288d7d"
server_key_iv: "adb8143e5d40453125cef86231e1fc72"
server_key_version: "encryptionkey@0"
I20260810 21:04:31.576110 19943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "8e1da9a5ec66462596f57dd8e6987e28"
format_stamp: "Formatted at 2026-08-10 21:04:31 on dist-test-slave-jq4t"
server_key: "0df70cb8b821e1a5724f69092c288d7d"
server_key_iv: "adb8143e5d40453125cef86231e1fc72"
server_key_version: "encryptionkey@0"
I20260810 21:04:31.577575 19943 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:04:31.578367 19967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:31.578557 19943 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:31.578670 19943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "8e1da9a5ec66462596f57dd8e6987e28"
format_stamp: "Formatted at 2026-08-10 21:04:31 on dist-test-slave-jq4t"
server_key: "0df70cb8b821e1a5724f69092c288d7d"
server_key_iv: "adb8143e5d40453125cef86231e1fc72"
server_key_version: "encryptionkey@0"
I20260810 21:04:31.578748 19943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:31.593526 19943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:31.596058 19943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:31.596235 19943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:31.596580 19943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:31.596949 19943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:31.597007 19943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:31.597051 19943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:31.597078 19943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:31.603541 19943 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:38733
I20260810 21:04:31.603623 20152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:38733 every 8 connection(s)
I20260810 21:04:31.603984 19943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:04:31.607748 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 19943
I20260810 21:04:31.607831 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:04:31.608017 15508 external_mini_cluster.cc:1428] Setting key 27dd2692920bcb8f586543230602a757
Aug 10 21:04:31 dist-test-slave-jq4t krb5kdc[19346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395871, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:31.614248 19478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:31.604888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:60091 (local address 127.15.37.62:33079)
0810 21:04:31.604966 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:31.604969 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:31.605193 (+ 224us) server_negotiation.cc:407] Connection header received
0810 21:04:31.605721 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:31.605722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:31.605733 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:31.605783 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:31.606825 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.607338 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.608924 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.609202 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.609258 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:31.611598 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:31.611600 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:31.611600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:31.611607 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:31.612888 (+ 1281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:31.613323 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:31.613324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:31.613324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:31.613376 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:31.613618 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:31.613619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:31.613619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:31.613725 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:31.613780 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:31.614113 (+ 333us) server_negotiation.cc:299] Negotiation successful
0810 21:04:31.614181 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 21:04:31.614504 20156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:31.604812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:33079 (local address 127.15.37.3:60091)
0810 21:04:31.605054 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:31.605099 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:31.605629 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:31.605859 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:31.605862 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:31.606516 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:31.606740 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:31.606745 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.607448 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.607449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:31.608676 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:31.608681 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:31.609290 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:31.609291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:31.609432 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:31.610047 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:31.610055 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:31.611508 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:31.612988 (+ 1480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:31.612995 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:31.612997 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:31.613248 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:31.613443 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:31.613443 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:31.613444 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:31.613557 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:31.613812 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:31.613819 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:31.613981 (+ 162us) client_negotiation.cc:769] Sending connection context
0810 21:04:31.614084 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 21:04:31.614217 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":112,"threads_started":1}
I20260810 21:04:31.615057 20154 heartbeater.cc:347] Connected to a master server at 127.15.37.62:33079
I20260810 21:04:31.615155 20154 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:31.615356 20154 heartbeater.cc:511] Master 127.15.37.62:33079 requested a full tablet report, sending...
I20260810 21:04:31.615816 19415 ts_manager.cc:194] Registered new tserver with Master: 8e1da9a5ec66462596f57dd8e6987e28 (127.15.37.3:38733)
I20260810 21:04:31.616207 19415 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:60091
I20260810 21:04:31.620005 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 21:04:31.634593 19478 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:04:31.633513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50166 (local address 127.15.37.62:33079)
0810 21:04:31.633595 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:31.633598 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:31.633731 (+ 133us) server_negotiation.cc:407] Connection header received
0810 21:04:31.633805 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:31.633807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:31.633819 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:31.633864 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:31.634516 (+ 652us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50166: BlockingRecv error: recv got EOF from 127.0.0.1:50166 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 21:04:31.635965 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 19514
I20260810 21:04:31.655217 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 19720
I20260810 21:04:31.669296 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 19943
I20260810 21:04:31.694710 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 19372
2026-08-10T21:04:31Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2187 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:04:31 dist-test-slave-jq4t krb5kdc[20178](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:04:31 dist-test-slave-jq4t krb5kdc[20178](info): set up 2 sockets
Aug 10 21:04:31 dist-test-slave-jq4t krb5kdc[20178](info): commencing operation
krb5kdc: starting...
W20260810 21:04:32.988785 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:04:33 dist-test-slave-jq4t krb5kdc[20178](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:04:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:04:33.124876 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39595
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:39595
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:33.211807 20198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:33.212088 20198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:33.212117 20198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:33.213392 20198 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:33.213441 20198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:33.213455 20198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:33.213469 20198 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:33.213481 20198 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:33.215137 20198 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:39595
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39595
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:33.215433 20198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:33.215693 20198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:33.221004 20209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:33.221104 20211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:33.221043 20208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:33.221283 20198 server_base.cc:1034] running on GCE node
I20260810 21:04:33.221598 20198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:33.221933 20198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:33.223124 20198 hybrid_clock.cc:648] HybridClock initialized: now 1786395873223120 us; error 42 us; skew 500 ppm
Aug 10 21:04:33 dist-test-slave-jq4t krb5kdc[20178](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395873, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:33.226063 20198 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:04:33.226501 20198 webserver.cc:460] Webserver started at http://127.15.37.62:39271/ using document root <none> and password file <none>
I20260810 21:04:33.226701 20198 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:33.226742 20198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:33.226835 20198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:33.227953 20198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "a664d9b688bd42f1aa05c6fc50ed7f18"
format_stamp: "Formatted at 2026-08-10 21:04:33 on dist-test-slave-jq4t"
server_key: "983e3404fcf86d9f5abd200c699712b5"
server_key_iv: "27264b1bbf0288c69f8e028c9b0a3652"
server_key_version: "encryptionkey@0"
I20260810 21:04:33.228283 20198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "a664d9b688bd42f1aa05c6fc50ed7f18"
format_stamp: "Formatted at 2026-08-10 21:04:33 on dist-test-slave-jq4t"
server_key: "983e3404fcf86d9f5abd200c699712b5"
server_key_iv: "27264b1bbf0288c69f8e028c9b0a3652"
server_key_version: "encryptionkey@0"
I20260810 21:04:33.229835 20198 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:33.230693 20222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:33.230940 20198 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:33.231055 20198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "a664d9b688bd42f1aa05c6fc50ed7f18"
format_stamp: "Formatted at 2026-08-10 21:04:33 on dist-test-slave-jq4t"
server_key: "983e3404fcf86d9f5abd200c699712b5"
server_key_iv: "27264b1bbf0288c69f8e028c9b0a3652"
server_key_version: "encryptionkey@0"
I20260810 21:04:33.231139 20198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:33.243448 20198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:33.246214 20198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:33.246409 20198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:33.250905 20198 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:39595
I20260810 21:04:33.250950 20298 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:39595 every 8 connection(s)
I20260810 21:04:33.251626 20198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:33.252411 20299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:33.254938 20299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18: Bootstrap starting.
I20260810 21:04:33.255548 20299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:33.255815 20299 log.cc:824] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:33.256726 20299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18: No bootstrap required, opened a new log
I20260810 21:04:33.258414 20299 raft_consensus.cc:348] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a664d9b688bd42f1aa05c6fc50ed7f18" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39595 } }
I20260810 21:04:33.258575 20299 raft_consensus.cc:374] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:33.258599 20299 raft_consensus.cc:729] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a664d9b688bd42f1aa05c6fc50ed7f18, State: Initialized, Role: FOLLOWER
I20260810 21:04:33.258767 20299 consensus_queue.cc:260] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a664d9b688bd42f1aa05c6fc50ed7f18" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39595 } }
I20260810 21:04:33.258865 20299 raft_consensus.cc:388] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:33.258893 20299 raft_consensus.cc:482] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:33.258926 20299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:33.259969 20299 raft_consensus.cc:504] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a664d9b688bd42f1aa05c6fc50ed7f18" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39595 } }
I20260810 21:04:33.260076 20299 leader_election.cc:302] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a664d9b688bd42f1aa05c6fc50ed7f18; no voters:
I20260810 21:04:33.260226 20299 leader_election.cc:288] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:33.260339 20303 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:33.260573 20303 raft_consensus.cc:686] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [term 1 LEADER]: Becoming Leader. State: Replica: a664d9b688bd42f1aa05c6fc50ed7f18, State: Running, Role: LEADER
I20260810 21:04:33.260687 20303 consensus_queue.cc:237] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a664d9b688bd42f1aa05c6fc50ed7f18" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39595 } }
I20260810 21:04:33.260759 20299 sys_catalog.cc:564] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:33.261098 20304 sys_catalog.cc:455] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a664d9b688bd42f1aa05c6fc50ed7f18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a664d9b688bd42f1aa05c6fc50ed7f18" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39595 } } }
I20260810 21:04:33.261214 20304 sys_catalog.cc:458] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:33.261417 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 20198
I20260810 21:04:33.261521 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:33.261703 15508 external_mini_cluster.cc:1428] Setting key b2141e2ed6d247b570970a2643bd389f
I20260810 21:04:33.261099 20305 sys_catalog.cc:455] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a664d9b688bd42f1aa05c6fc50ed7f18. Latest consensus state: current_term: 1 leader_uuid: "a664d9b688bd42f1aa05c6fc50ed7f18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a664d9b688bd42f1aa05c6fc50ed7f18" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39595 } } }
I20260810 21:04:33.261886 20305 sys_catalog.cc:458] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:33.262101 20310 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:33.262717 20310 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:33.264658 20310 catalog_manager.cc:1347] Generated new cluster ID: 91dfe5a105e941df8eeceb77a870e3e7
I20260810 21:04:33.264719 20310 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:04:33 dist-test-slave-jq4t krb5kdc[20178](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:33.273134 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:33.262489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54696 (local address 127.15.37.62:39595)
0810 21:04:33.262692 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:33.262702 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:33.262737 (+ 35us) server_negotiation.cc:407] Connection header received
0810 21:04:33.262909 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:33.262919 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:33.262984 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:33.263134 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:33.263937 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:33.265181 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:33.265964 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:33.266428 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:33.266555 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:33.269103 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:33.269112 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:33.269112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:33.269125 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:33.271331 (+ 2206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:33.271757 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:33.271762 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:33.271762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:33.271880 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:33.272122 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:33.272123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:33.272123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:33.272418 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:33.272659 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:33.272735 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 21:04:33.272900 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":87,"threads_started":1}
I20260810 21:04:33.274272 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:04:33.277866 20310 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:33.278589 20310 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:33.299042 20332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:33.294331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54700 (local address 127.15.37.62:39595)
0810 21:04:33.294383 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:33.294386 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:33.294475 (+ 89us) server_negotiation.cc:407] Connection header received
0810 21:04:33.294536 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:33.294537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:33.294551 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:33.294632 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:33.295087 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:33.295964 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:33.297106 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:33.297473 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:33.297562 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:33.298423 (+ 861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:33.298426 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:33.298426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:33.298706 (+ 280us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:33.298729 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:33.298738 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:33.298806 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:33.298914 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 21:04:33.298940 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 21:04:33.299685 20310 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a664d9b688bd42f1aa05c6fc50ed7f18: Generated new TSK 0
I20260810 21:04:33.299966 20310 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:04:33.306000 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 20198
2026-08-10T21:04:33Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1610 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:04:33 dist-test-slave-jq4t krb5kdc[20352](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:04:33 dist-test-slave-jq4t krb5kdc[20352](info): set up 2 sockets
Aug 10 21:04:33 dist-test-slave-jq4t krb5kdc[20352](info): commencing operation
krb5kdc: starting...
W20260810 21:04:35.268441 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.933s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:04:35 dist-test-slave-jq4t krb5kdc[20352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:04:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:04:35.465268 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:38995
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:32811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:38995
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:35.621637 20371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:35.622066 20371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:35.622115 20371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:35.624297 20371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:35.624418 20371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:35.624636 20371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:35.624727 20371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:35.624750 20371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:35.627871 20371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:32811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:38995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:38995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:35.628311 20371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:35.628731 20371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:35.639278 20381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:35.639448 20384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:35.639456 20371 server_base.cc:1034] running on GCE node
W20260810 21:04:35.639953 20387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:35.640430 20371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:35.641125 20371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:35.642509 20371 hybrid_clock.cc:648] HybridClock initialized: now 1786395875642469 us; error 84 us; skew 500 ppm
Aug 10 21:04:35 dist-test-slave-jq4t krb5kdc[20352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395875, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:35.647596 20371 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:04:35.648672 20371 webserver.cc:460] Webserver started at http://127.15.37.62:33649/ using document root <none> and password file <none>
I20260810 21:04:35.649143 20371 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:35.649221 20371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:35.649550 20371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:35.651654 20371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "9379fe3b606748f08f4a4fb14df398f0"
format_stamp: "Formatted at 2026-08-10 21:04:35 on dist-test-slave-jq4t"
server_key: "39b1d002b502d3cadf26fbccb6a66e18"
server_key_iv: "bce1a6da3840f1da853717141b11ae8b"
server_key_version: "encryptionkey@0"
I20260810 21:04:35.652395 20371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "9379fe3b606748f08f4a4fb14df398f0"
format_stamp: "Formatted at 2026-08-10 21:04:35 on dist-test-slave-jq4t"
server_key: "39b1d002b502d3cadf26fbccb6a66e18"
server_key_iv: "bce1a6da3840f1da853717141b11ae8b"
server_key_version: "encryptionkey@0"
I20260810 21:04:35.655258 20371 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 21:04:35.656996 20394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:35.657372 20371 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:35.657596 20371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "9379fe3b606748f08f4a4fb14df398f0"
format_stamp: "Formatted at 2026-08-10 21:04:35 on dist-test-slave-jq4t"
server_key: "39b1d002b502d3cadf26fbccb6a66e18"
server_key_iv: "bce1a6da3840f1da853717141b11ae8b"
server_key_version: "encryptionkey@0"
I20260810 21:04:35.657725 20371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:35.687238 20371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:35.691911 20371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:35.692209 20371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:35.700870 20371 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:38995
I20260810 21:04:35.701004 20471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:38995 every 8 connection(s)
I20260810 21:04:35.701697 20371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:35.704254 20473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:35.708635 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 20371
I20260810 21:04:35.708863 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:35.709230 15508 external_mini_cluster.cc:1428] Setting key 139bfa289f28f9e0f50cd1e69c8c4432
I20260810 21:04:35.709414 20473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0: Bootstrap starting.
I20260810 21:04:35.710917 20473 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:35.711421 20473 log.cc:824] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:35.713485 20473 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0: No bootstrap required, opened a new log
I20260810 21:04:35.717407 20473 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9379fe3b606748f08f4a4fb14df398f0" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38995 } }
I20260810 21:04:35.717728 20473 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:35.717836 20473 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9379fe3b606748f08f4a4fb14df398f0, State: Initialized, Role: FOLLOWER
I20260810 21:04:35.718181 20473 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9379fe3b606748f08f4a4fb14df398f0" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38995 } }
I20260810 21:04:35.718405 20473 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:35.718492 20473 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:35.718606 20473 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:35.719892 20473 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9379fe3b606748f08f4a4fb14df398f0" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38995 } }
I20260810 21:04:35.720144 20473 leader_election.cc:302] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9379fe3b606748f08f4a4fb14df398f0; no voters:
I20260810 21:04:35.720577 20473 leader_election.cc:288] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:35.720651 20480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:35.721001 20480 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [term 1 LEADER]: Becoming Leader. State: Replica: 9379fe3b606748f08f4a4fb14df398f0, State: Running, Role: LEADER
I20260810 21:04:35.721135 20473 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:35.721329 20480 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9379fe3b606748f08f4a4fb14df398f0" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38995 } }
Aug 10 21:04:35 dist-test-slave-jq4t krb5kdc[20352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:35.722028 20480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9379fe3b606748f08f4a4fb14df398f0. Latest consensus state: current_term: 1 leader_uuid: "9379fe3b606748f08f4a4fb14df398f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9379fe3b606748f08f4a4fb14df398f0" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38995 } } }
I20260810 21:04:35.722052 20482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9379fe3b606748f08f4a4fb14df398f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9379fe3b606748f08f4a4fb14df398f0" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38995 } } }
I20260810 21:04:35.722327 20480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:35.722338 20482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:35.724740 20495 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:35.725983 20495 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:35.730080 20477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:35.710174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52904 (local address 127.15.37.62:38995)
0810 21:04:35.710488 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:35.710506 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:35.710548 (+ 42us) server_negotiation.cc:407] Connection header received
0810 21:04:35.711395 (+ 847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:35.711403 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:35.711542 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:35.711799 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:35.713443 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:35.715516 (+ 2073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:35.716930 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:35.717694 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:35.717932 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:35.722941 (+ 5009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:35.722958 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:35.722958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:35.722987 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:35.726604 (+ 3617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:35.727443 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:35.727455 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:35.727455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:35.727614 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:35.728059 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:35.728060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:35.728061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:35.728628 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:35.728980 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:35.729587 (+ 607us) server_negotiation.cc:299] Negotiation successful
0810 21:04:35.729813 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":167,"threads_started":1}
I20260810 21:04:35.731022 20495 catalog_manager.cc:1347] Generated new cluster ID: 30a8a89a58ae4044b74f077779e2355b
I20260810 21:04:35.731123 20495 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:04:35.739480 20495 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:35.740767 20495 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:35.748719 20495 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9379fe3b606748f08f4a4fb14df398f0: Generated new TSK 0
I20260810 21:04:35.749086 20495 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:04:35.792703 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38995
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:32811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:35.941268 20510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:35.941568 20510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:35.941596 20510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:35.943594 20510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:35.943718 20510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:35.943820 20510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:04:35.946364 20510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:32811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:35.946856 20510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:35.947268 20510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:35.958184 20521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:35.958168 20520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:35.958817 20510 server_base.cc:1034] running on GCE node
W20260810 21:04:35.958173 20524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:35.959311 20510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:35.959904 20510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:35.961153 20510 hybrid_clock.cc:648] HybridClock initialized: now 1786395875961144 us; error 58 us; skew 500 ppm
Aug 10 21:04:35 dist-test-slave-jq4t krb5kdc[20352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395875, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:35.967267 20510 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:04:35.968180 20510 webserver.cc:460] Webserver started at http://127.15.37.1:44207/ using document root <none> and password file <none>
I20260810 21:04:35.968654 20510 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:35.968756 20510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:35.969056 20510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:35.971048 20510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "9b287bdf2ada4e49a93094eddd99faad"
format_stamp: "Formatted at 2026-08-10 21:04:35 on dist-test-slave-jq4t"
server_key: "ed59e9cd3d271b9791b634ecabe41a7b"
server_key_iv: "4f16e17df485d926371a16fa7bd70dca"
server_key_version: "encryptionkey@0"
I20260810 21:04:35.971733 20510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "9b287bdf2ada4e49a93094eddd99faad"
format_stamp: "Formatted at 2026-08-10 21:04:35 on dist-test-slave-jq4t"
server_key: "ed59e9cd3d271b9791b634ecabe41a7b"
server_key_iv: "4f16e17df485d926371a16fa7bd70dca"
server_key_version: "encryptionkey@0"
I20260810 21:04:35.974598 20510 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.006s sys 0.000s
I20260810 21:04:35.976241 20534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:35.976712 20510 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:35.976897 20510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "9b287bdf2ada4e49a93094eddd99faad"
format_stamp: "Formatted at 2026-08-10 21:04:35 on dist-test-slave-jq4t"
server_key: "ed59e9cd3d271b9791b634ecabe41a7b"
server_key_iv: "4f16e17df485d926371a16fa7bd70dca"
server_key_version: "encryptionkey@0"
I20260810 21:04:35.977027 20510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:36.008296 20510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:36.013000 20510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:36.013334 20510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:36.013785 20510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:36.014653 20510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:36.014782 20510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:36.014910 20510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:36.014994 20510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:36.027539 20510 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:38297
I20260810 21:04:36.027679 20711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:38297 every 8 connection(s)
I20260810 21:04:36.028424 20510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:04:36.034274 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 20510
I20260810 21:04:36.034425 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:04:36.034739 15508 external_mini_cluster.cc:1428] Setting key c773c3e7170d31bdbb9c1ec681ce3051
Aug 10 21:04:36 dist-test-slave-jq4t krb5kdc[20352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395875, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
I20260810 21:04:36.053862 20477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:36.029919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:42287 (local address 127.15.37.62:38995)
0810 21:04:36.030044 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:36.030046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:36.030493 (+ 447us) server_negotiation.cc:407] Connection header received
0810 21:04:36.031600 (+ 1107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:36.031602 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:36.031632 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:36.031751 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:36.033888 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.034848 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.036844 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.037202 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.037373 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:36.047765 (+ 10392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:36.047767 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:36.047768 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:36.047792 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:36.050781 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:36.051736 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:36.051738 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:36.051738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:36.051855 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:36.052421 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:36.052423 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:36.052435 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:36.052718 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:36.052928 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:36.053495 (+ 567us) server_negotiation.cc:299] Negotiation successful
0810 21:04:36.053690 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 21:04:36.054235 20717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:36.029865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:38995 (local address 127.15.37.1:42287)
0810 21:04:36.030244 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:36.030320 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:36.031309 (+ 989us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:36.031908 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:36.031919 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:36.033179 (+ 1260us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:36.033612 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:36.033629 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.035073 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.035074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:36.036654 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:36.036657 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.037401 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.037404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:36.037656 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:36.044027 (+ 6371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:36.044057 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:36.047496 (+ 3439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:36.051023 (+ 3527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:36.051051 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:36.051060 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:36.051560 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:36.051990 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:36.051992 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:36.051992 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:36.052257 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:36.052904 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:36.052925 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:36.053213 (+ 288us) client_negotiation.cc:769] Sending connection context
0810 21:04:36.053426 (+ 213us) client_negotiation.cc:240] Negotiation successful
0810 21:04:36.053775 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":186,"threads_started":1}
I20260810 21:04:36.055222 20712 heartbeater.cc:347] Connected to a master server at 127.15.37.62:38995
I20260810 21:04:36.055444 20712 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:36.055807 20712 heartbeater.cc:511] Master 127.15.37.62:38995 requested a full tablet report, sending...
I20260810 21:04:36.056860 20418 ts_manager.cc:194] Registered new tserver with Master: 9b287bdf2ada4e49a93094eddd99faad (127.15.37.1:38297)
I20260810 21:04:36.058616 20418 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:42287
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:04:36.081575 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38995
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:32811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:36.226780 20721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:36.227239 20721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:36.227329 20721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:36.229521 20721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:36.229674 20721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:36.229766 20721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:04:36.232770 20721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:32811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:36.233353 20721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:36.233848 20721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:36.242924 20732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:36.242925 20730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:36.243096 20734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:36.243400 20721 server_base.cc:1034] running on GCE node
I20260810 21:04:36.243873 20721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:36.244340 20721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:36.245581 20721 hybrid_clock.cc:648] HybridClock initialized: now 1786395876245542 us; error 61 us; skew 500 ppm
Aug 10 21:04:36 dist-test-slave-jq4t krb5kdc[20352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395876, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:36.250712 20721 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:04:36.251749 20721 webserver.cc:460] Webserver started at http://127.15.37.2:38857/ using document root <none> and password file <none>
I20260810 21:04:36.252158 20721 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:36.252249 20721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:36.252547 20721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:36.254491 20721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "fa0304e34cb84b08aeef698cbf5a0a1e"
format_stamp: "Formatted at 2026-08-10 21:04:36 on dist-test-slave-jq4t"
server_key: "a1d866c441387301705c340b968f05c6"
server_key_iv: "7f4750bf20a1add634f46168203bf6f8"
server_key_version: "encryptionkey@0"
I20260810 21:04:36.255055 20721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "fa0304e34cb84b08aeef698cbf5a0a1e"
format_stamp: "Formatted at 2026-08-10 21:04:36 on dist-test-slave-jq4t"
server_key: "a1d866c441387301705c340b968f05c6"
server_key_iv: "7f4750bf20a1add634f46168203bf6f8"
server_key_version: "encryptionkey@0"
I20260810 21:04:36.257647 20721 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.005s sys 0.000s
I20260810 21:04:36.258996 20746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:36.259347 20721 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:36.259545 20721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "fa0304e34cb84b08aeef698cbf5a0a1e"
format_stamp: "Formatted at 2026-08-10 21:04:36 on dist-test-slave-jq4t"
server_key: "a1d866c441387301705c340b968f05c6"
server_key_iv: "7f4750bf20a1add634f46168203bf6f8"
server_key_version: "encryptionkey@0"
I20260810 21:04:36.259719 20721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:36.274874 20721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:36.279606 20721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:36.280004 20721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:36.280445 20721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:36.280900 20721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:36.280979 20721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:36.281095 20721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:36.281178 20721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:36.294970 20721 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:43987
I20260810 21:04:36.295066 20904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:43987 every 8 connection(s)
I20260810 21:04:36.295680 20721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:04:36.303638 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 20721
I20260810 21:04:36.303850 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:04:36.304229 15508 external_mini_cluster.cc:1428] Setting key 8bf24cee6b12592b5a761e21bca52fec
Aug 10 21:04:36 dist-test-slave-jq4t krb5kdc[20352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395876, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:36.317137 20477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:36.297121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:34869 (local address 127.15.37.62:38995)
0810 21:04:36.297317 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:36.297322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:36.297877 (+ 555us) server_negotiation.cc:407] Connection header received
0810 21:04:36.298868 (+ 991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:36.298869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:36.298893 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:36.299001 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:36.301089 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.301936 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.304165 (+ 2229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.304728 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.304821 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:36.310947 (+ 6126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:36.310951 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:36.310951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:36.310963 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:36.314012 (+ 3049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:36.314928 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:36.314930 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:36.314930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:36.315034 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:36.315544 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:36.315545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:36.315546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:36.315761 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:36.316035 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:36.316610 (+ 575us) server_negotiation.cc:299] Negotiation successful
0810 21:04:36.316940 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 21:04:36.317581 20911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:36.297077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:38995 (local address 127.15.37.2:34869)
0810 21:04:36.297470 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:36.297634 (+ 164us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:36.298651 (+ 1017us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:36.299136 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:36.299148 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:36.300265 (+ 1117us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:36.300882 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:36.300889 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.302090 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.302091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:36.303941 (+ 1850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:36.303945 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.304874 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.304890 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:36.305572 (+ 682us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:36.306697 (+ 1125us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:36.306722 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:36.310698 (+ 3976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:36.314212 (+ 3514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:36.314235 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:36.314239 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:36.314768 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:36.315184 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:36.315185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:36.315185 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:36.315410 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:36.316011 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:36.316023 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:36.316303 (+ 280us) client_negotiation.cc:769] Sending connection context
0810 21:04:36.316594 (+ 291us) client_negotiation.cc:240] Negotiation successful
0810 21:04:36.317102 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":264,"threads_started":1}
I20260810 21:04:36.319110 20908 heartbeater.cc:347] Connected to a master server at 127.15.37.62:38995
I20260810 21:04:36.319309 20908 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:36.319777 20908 heartbeater.cc:511] Master 127.15.37.62:38995 requested a full tablet report, sending...
I20260810 21:04:36.320794 20418 ts_manager.cc:194] Registered new tserver with Master: fa0304e34cb84b08aeef698cbf5a0a1e (127.15.37.2:43987)
I20260810 21:04:36.321851 20418 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:34869
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:04:36.353223 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38995
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:32811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:36.506588 20915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:36.507038 20915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:36.507087 20915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:36.509392 20915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:36.509491 20915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:36.509543 20915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:04:36.512451 20915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:32811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38995
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:36.512989 20915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:36.513453 20915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:36.523078 20926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:36.523063 20922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:36.523063 20928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:36.524403 20915 server_base.cc:1034] running on GCE node
I20260810 21:04:36.524899 20915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:36.525368 20915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:36.526624 20915 hybrid_clock.cc:648] HybridClock initialized: now 1786395876526613 us; error 68 us; skew 500 ppm
Aug 10 21:04:36 dist-test-slave-jq4t krb5kdc[20352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395876, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:36.532696 20915 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:04:36.533670 20915 webserver.cc:460] Webserver started at http://127.15.37.3:42987/ using document root <none> and password file <none>
I20260810 21:04:36.534046 20915 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:36.534221 20915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:36.534431 20915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:36.536592 20915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "bcff6d2be48f4416bd95905b8621e35c"
format_stamp: "Formatted at 2026-08-10 21:04:36 on dist-test-slave-jq4t"
server_key: "37d87719752e99e5e3e4643578044db2"
server_key_iv: "674e4d3f2a6e5a45d62331929fe41009"
server_key_version: "encryptionkey@0"
I20260810 21:04:36.537318 20915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "bcff6d2be48f4416bd95905b8621e35c"
format_stamp: "Formatted at 2026-08-10 21:04:36 on dist-test-slave-jq4t"
server_key: "37d87719752e99e5e3e4643578044db2"
server_key_iv: "674e4d3f2a6e5a45d62331929fe41009"
server_key_version: "encryptionkey@0"
I20260810 21:04:36.540169 20915 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260810 21:04:36.541640 20937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:36.541956 20915 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:36.542142 20915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "bcff6d2be48f4416bd95905b8621e35c"
format_stamp: "Formatted at 2026-08-10 21:04:36 on dist-test-slave-jq4t"
server_key: "37d87719752e99e5e3e4643578044db2"
server_key_iv: "674e4d3f2a6e5a45d62331929fe41009"
server_key_version: "encryptionkey@0"
I20260810 21:04:36.542260 20915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:36.579315 20915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:36.583705 20915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:36.583985 20915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:36.584527 20915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:36.585106 20915 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:36.585182 20915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:36.585251 20915 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:36.585307 20915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:36.597949 20915 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:45397
I20260810 21:04:36.598110 21111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:45397 every 8 connection(s)
I20260810 21:04:36.598417 20915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:04:36.605715 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 20915
I20260810 21:04:36.605952 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:04:36.606280 15508 external_mini_cluster.cc:1428] Setting key 1df25d335f04b3cfc9ce4e1f522e6798
Aug 10 21:04:36 dist-test-slave-jq4t krb5kdc[20352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395876, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:36.618183 20477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:36.599861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:44663 (local address 127.15.37.62:38995)
0810 21:04:36.600002 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:36.600004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:36.600322 (+ 318us) server_negotiation.cc:407] Connection header received
0810 21:04:36.601450 (+ 1128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:36.601451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:36.601480 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:36.601568 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:36.603569 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.604436 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.606802 (+ 2366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.607438 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.607601 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:36.612107 (+ 4506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:36.612109 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:36.612110 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:36.612120 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:36.615149 (+ 3029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:36.616078 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:36.616079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:36.616080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:36.616176 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:36.616799 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:36.616801 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:36.616802 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:36.617016 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:36.617164 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:36.617803 (+ 639us) server_negotiation.cc:299] Negotiation successful
0810 21:04:36.617972 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260810 21:04:36.618755 21119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:36.599769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:38995 (local address 127.15.37.3:44663)
0810 21:04:36.600087 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:36.600160 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:36.601179 (+ 1019us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:36.601714 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:36.601718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:36.602892 (+ 1174us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:36.603381 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:36.603394 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.604777 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.604778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:36.606602 (+ 1824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:36.606616 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.607638 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.607639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:36.607963 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:36.609116 (+ 1153us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:36.609143 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:36.611829 (+ 2686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:36.615435 (+ 3606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:36.615458 (+ 23us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:36.615470 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:36.615920 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:36.616292 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:36.616292 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:36.616293 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:36.616643 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:36.617150 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:36.617159 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:36.617516 (+ 357us) client_negotiation.cc:769] Sending connection context
0810 21:04:36.617734 (+ 218us) client_negotiation.cc:240] Negotiation successful
0810 21:04:36.618122 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":177,"threads_started":1}
I20260810 21:04:36.619774 21115 heartbeater.cc:347] Connected to a master server at 127.15.37.62:38995
I20260810 21:04:36.620038 21115 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:36.620538 21115 heartbeater.cc:511] Master 127.15.37.62:38995 requested a full tablet report, sending...
I20260810 21:04:36.621548 20418 ts_manager.cc:194] Registered new tserver with Master: bcff6d2be48f4416bd95905b8621e35c (127.15.37.3:45397)
I20260810 21:04:36.622226 20418 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:44663
I20260810 21:04:36.631654 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 21:04:36 dist-test-slave-jq4t krb5kdc[20352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395876, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 10 21:04:36 dist-test-slave-jq4t krb5kdc[20352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395876, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:36.679653 20477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:36.664668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52906 (local address 127.15.37.62:38995)
0810 21:04:36.664807 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:36.664820 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:36.665248 (+ 428us) server_negotiation.cc:407] Connection header received
0810 21:04:36.665499 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:36.665500 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:36.665523 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:36.665658 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:36.666996 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.667970 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.669440 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:36.669757 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:36.669925 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:36.674428 (+ 4503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:36.674429 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:36.674429 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:36.674447 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:36.677126 (+ 2679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:36.677809 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:36.677820 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:36.677821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:36.677921 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:36.678437 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:36.678438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:36.678438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:36.678715 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:36.679056 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:36.679296 (+ 240us) server_negotiation.cc:299] Negotiation successful
0810 21:04:36.679464 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260810 21:04:36.680037 20418 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52906
I20260810 21:04:36.680825 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 20510
I20260810 21:04:36.703271 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 20721
I20260810 21:04:36.745445 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 20915
I20260810 21:04:36.772192 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 20371
2026-08-10T21:04:36Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3477 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:04:36 dist-test-slave-jq4t krb5kdc[21137](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:04:36 dist-test-slave-jq4t krb5kdc[21137](info): set up 2 sockets
Aug 10 21:04:36 dist-test-slave-jq4t krb5kdc[21137](info): commencing operation
krb5kdc: starting...
W20260810 21:04:38.314489 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.501s user 0.000s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:04:38 dist-test-slave-jq4t krb5kdc[21137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:04:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:04:38.447018 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:43261
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:43261
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:38.536180 21158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:38.536430 21158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:38.536458 21158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:38.537774 21158 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:38.537828 21158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:38.537842 21158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:38.537856 21158 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:38.537868 21158 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:38.539561 21158 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:43261
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:43261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:38.539880 21158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:38.540158 21158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:38.545840 21170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:38.545893 21158 server_base.cc:1034] running on GCE node
W20260810 21:04:38.545836 21171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:38.545830 21173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:38.546376 21158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:38.546722 21158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:38.547883 21158 hybrid_clock.cc:648] HybridClock initialized: now 1786395878547860 us; error 44 us; skew 500 ppm
Aug 10 21:04:38 dist-test-slave-jq4t krb5kdc[21137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395878, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:38.550704 21158 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:04:38.551263 21158 webserver.cc:460] Webserver started at http://127.15.37.62:43323/ using document root <none> and password file <none>
I20260810 21:04:38.551518 21158 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:38.551591 21158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:38.551748 21158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:38.553004 21158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "ab36f84f97514bb3933bd7b11badd6bd"
format_stamp: "Formatted at 2026-08-10 21:04:38 on dist-test-slave-jq4t"
server_key: "8d1c6e5aa756ee5f57c9f54c4ad9ad02"
server_key_iv: "4ba6ab1db3daf841ec11dd5ff71d1814"
server_key_version: "encryptionkey@0"
I20260810 21:04:38.553385 21158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "ab36f84f97514bb3933bd7b11badd6bd"
format_stamp: "Formatted at 2026-08-10 21:04:38 on dist-test-slave-jq4t"
server_key: "8d1c6e5aa756ee5f57c9f54c4ad9ad02"
server_key_iv: "4ba6ab1db3daf841ec11dd5ff71d1814"
server_key_version: "encryptionkey@0"
I20260810 21:04:38.554801 21158 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:04:38.555583 21183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:38.555766 21158 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 21:04:38.555882 21158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "ab36f84f97514bb3933bd7b11badd6bd"
format_stamp: "Formatted at 2026-08-10 21:04:38 on dist-test-slave-jq4t"
server_key: "8d1c6e5aa756ee5f57c9f54c4ad9ad02"
server_key_iv: "4ba6ab1db3daf841ec11dd5ff71d1814"
server_key_version: "encryptionkey@0"
I20260810 21:04:38.555964 21158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:38.571290 21158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:38.574038 21158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:38.574218 21158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:38.578652 21158 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:43261
I20260810 21:04:38.578694 21263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:43261 every 8 connection(s)
I20260810 21:04:38.579229 21158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:38.579948 21264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:38.582613 21264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd: Bootstrap starting.
I20260810 21:04:38.583281 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 21158
I20260810 21:04:38.583328 21264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:38.583384 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:38.583575 15508 external_mini_cluster.cc:1428] Setting key a73644708d7cc4757de3df6660f38728
I20260810 21:04:38.583699 21264 log.cc:824] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:38.584672 21264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd: No bootstrap required, opened a new log
I20260810 21:04:38.587296 21264 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab36f84f97514bb3933bd7b11badd6bd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43261 } }
I20260810 21:04:38.587483 21264 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:38.587519 21264 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab36f84f97514bb3933bd7b11badd6bd, State: Initialized, Role: FOLLOWER
I20260810 21:04:38.587658 21264 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab36f84f97514bb3933bd7b11badd6bd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43261 } }
I20260810 21:04:38.587755 21264 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:38.587806 21264 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:38.587868 21264 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:38.588527 21264 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab36f84f97514bb3933bd7b11badd6bd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43261 } }
I20260810 21:04:38.588665 21264 leader_election.cc:302] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab36f84f97514bb3933bd7b11badd6bd; no voters:
I20260810 21:04:38.588894 21264 leader_election.cc:288] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:38.588928 21273 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:38.589048 21273 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [term 1 LEADER]: Becoming Leader. State: Replica: ab36f84f97514bb3933bd7b11badd6bd, State: Running, Role: LEADER
I20260810 21:04:38.589205 21264 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:38.589236 21273 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab36f84f97514bb3933bd7b11badd6bd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43261 } }
I20260810 21:04:38.589754 21277 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab36f84f97514bb3933bd7b11badd6bd. Latest consensus state: current_term: 1 leader_uuid: "ab36f84f97514bb3933bd7b11badd6bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab36f84f97514bb3933bd7b11badd6bd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43261 } } }
I20260810 21:04:38.589896 21277 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:38.590078 21278 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab36f84f97514bb3933bd7b11badd6bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab36f84f97514bb3933bd7b11badd6bd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43261 } } }
I20260810 21:04:38.590160 21278 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:38.591223 21283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 10 21:04:38 dist-test-slave-jq4t krb5kdc[21137](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:38.591894 21283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:38.593875 21283 catalog_manager.cc:1347] Generated new cluster ID: 6130b338c361442d988af083bcc15c27
I20260810 21:04:38.593946 21283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:04:38.596069 21272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:38.584177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35928 (local address 127.15.37.62:43261)
0810 21:04:38.584353 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:38.584364 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:38.584403 (+ 39us) server_negotiation.cc:407] Connection header received
0810 21:04:38.585094 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:38.585105 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:38.585177 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:38.585348 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:38.586005 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:38.587515 (+ 1510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:38.588564 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:38.589349 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:38.589796 (+ 447us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:38.592308 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:38.592313 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:38.592313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:38.592326 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:38.594428 (+ 2102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:38.594819 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:38.594822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:38.594823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:38.594920 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:38.595142 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:38.595143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:38.595143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:38.595410 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:38.595583 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:38.595726 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 21:04:38.595873 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":82,"threads_started":1}
I20260810 21:04:38.605928 21283 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:38.606550 21283 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:38.609578 21283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab36f84f97514bb3933bd7b11badd6bd: Generated new TSK 0
I20260810 21:04:38.609789 21283 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:04:38.643642 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:43261
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:38.737210 21311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:38.737473 21311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:38.737516 21311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:38.738775 21311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:38.738854 21311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:38.738910 21311 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:04:38.740679 21311 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:43261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:38.740980 21311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:38.741226 21311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:38.746665 21326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:38.746665 21321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:38.746660 21323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:38.747007 21311 server_base.cc:1034] running on GCE node
I20260810 21:04:38.747318 21311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:38.747586 21311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:38.748756 21311 hybrid_clock.cc:648] HybridClock initialized: now 1786395878748749 us; error 38 us; skew 500 ppm
Aug 10 21:04:38 dist-test-slave-jq4t krb5kdc[21137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395878, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:38.754735 21311 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:04:38.755266 21311 webserver.cc:460] Webserver started at http://127.15.37.1:33521/ using document root <none> and password file <none>
I20260810 21:04:38.755482 21311 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:38.755527 21311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:38.755626 21311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:38.756808 21311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "4a06db4d9c434428aba4c10a13ca22ad"
format_stamp: "Formatted at 2026-08-10 21:04:38 on dist-test-slave-jq4t"
server_key: "a0090ba4f1e2b206401ba92121886c6b"
server_key_iv: "8d613826d859536e6f25a0c970bf6173"
server_key_version: "encryptionkey@0"
I20260810 21:04:38.757149 21311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "4a06db4d9c434428aba4c10a13ca22ad"
format_stamp: "Formatted at 2026-08-10 21:04:38 on dist-test-slave-jq4t"
server_key: "a0090ba4f1e2b206401ba92121886c6b"
server_key_iv: "8d613826d859536e6f25a0c970bf6173"
server_key_version: "encryptionkey@0"
I20260810 21:04:38.758561 21311 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:04:38.759461 21335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:38.759675 21311 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:38.759771 21311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "4a06db4d9c434428aba4c10a13ca22ad"
format_stamp: "Formatted at 2026-08-10 21:04:38 on dist-test-slave-jq4t"
server_key: "a0090ba4f1e2b206401ba92121886c6b"
server_key_iv: "8d613826d859536e6f25a0c970bf6173"
server_key_version: "encryptionkey@0"
I20260810 21:04:38.759833 21311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:38.776610 21311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:38.779202 21311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:38.779335 21311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:38.779554 21311 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:38.779940 21311 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:38.779983 21311 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:38.780009 21311 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:38.780021 21311 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:38.786304 21311 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:37699
I20260810 21:04:38.786396 21508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:37699 every 8 connection(s)
I20260810 21:04:38.786768 21311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:04:38.790849 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 21311
I20260810 21:04:38.791000 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:04:38.791220 15508 external_mini_cluster.cc:1428] Setting key 8a23218edbc8982c6a31830b0ba24641
Aug 10 21:04:38 dist-test-slave-jq4t krb5kdc[21137](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395878, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:38.798563 21272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:38.787657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:35769 (local address 127.15.37.62:43261)
0810 21:04:38.787731 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:38.787736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:38.787922 (+ 186us) server_negotiation.cc:407] Connection header received
0810 21:04:38.789014 (+ 1092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:38.789015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:38.789029 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:38.789083 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:38.789759 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:38.790360 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:38.791821 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:38.792133 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:38.792192 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:38.795101 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:38.795103 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:38.795104 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:38.795114 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:38.796859 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:38.797409 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:38.797411 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:38.797411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:38.797484 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:38.797750 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:38.797751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:38.797751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:38.797927 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:38.798024 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:38.798307 (+ 283us) server_negotiation.cc:299] Negotiation successful
0810 21:04:38.798419 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 21:04:38.798578 21511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:38.787599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:43261 (local address 127.15.37.1:35769)
0810 21:04:38.787804 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:38.787844 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:38.788913 (+ 1069us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:38.789141 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:38.789145 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:38.789428 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:38.789637 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:38.789641 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:38.790450 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:38.790451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:38.791733 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:38.791736 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:38.792228 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:38.792230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:38.792398 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:38.793013 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:38.793025 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:38.794978 (+ 1953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:38.796973 (+ 1995us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:38.796983 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:38.796986 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:38.797311 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:38.797562 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:38.797563 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:38.797563 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:38.797676 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:38.798014 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:38.798020 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:38.798158 (+ 138us) client_negotiation.cc:769] Sending connection context
0810 21:04:38.798247 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 21:04:38.798398 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":70,"threads_started":1}
I20260810 21:04:38.799338 21509 heartbeater.cc:347] Connected to a master server at 127.15.37.62:43261
I20260810 21:04:38.799465 21509 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:38.799705 21509 heartbeater.cc:511] Master 127.15.37.62:43261 requested a full tablet report, sending...
I20260810 21:04:38.800285 21207 ts_manager.cc:194] Registered new tserver with Master: 4a06db4d9c434428aba4c10a13ca22ad (127.15.37.1:37699)
I20260810 21:04:38.800984 21207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:35769
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:04:38.821713 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:43261
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:38.926492 21514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:38.926726 21514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:38.926752 21514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:38.927863 21514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:38.927901 21514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:38.927927 21514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:04:38.929466 21514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:43261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:38.929688 21514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:38.929874 21514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:38.935163 21523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:38.935201 21522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:38.935410 21514 server_base.cc:1034] running on GCE node
W20260810 21:04:38.935179 21525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:38.935740 21514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:38.936005 21514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:38.937172 21514 hybrid_clock.cc:648] HybridClock initialized: now 1786395878937154 us; error 44 us; skew 500 ppm
Aug 10 21:04:38 dist-test-slave-jq4t krb5kdc[21137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395878, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:38.939914 21514 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:04:38.940393 21514 webserver.cc:460] Webserver started at http://127.15.37.2:38731/ using document root <none> and password file <none>
I20260810 21:04:38.940651 21514 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:38.940701 21514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:38.940800 21514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:38.941890 21514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "885907fb61f14e6184de133729206cfe"
format_stamp: "Formatted at 2026-08-10 21:04:38 on dist-test-slave-jq4t"
server_key: "dd780c56dad2688ba93286fa8b0690dd"
server_key_iv: "c03522f6b5a53f2b54a166b5b4b237e8"
server_key_version: "encryptionkey@0"
I20260810 21:04:38.942214 21514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "885907fb61f14e6184de133729206cfe"
format_stamp: "Formatted at 2026-08-10 21:04:38 on dist-test-slave-jq4t"
server_key: "dd780c56dad2688ba93286fa8b0690dd"
server_key_iv: "c03522f6b5a53f2b54a166b5b4b237e8"
server_key_version: "encryptionkey@0"
I20260810 21:04:38.943619 21514 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:38.944559 21534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:38.944769 21514 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:38.944876 21514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "885907fb61f14e6184de133729206cfe"
format_stamp: "Formatted at 2026-08-10 21:04:38 on dist-test-slave-jq4t"
server_key: "dd780c56dad2688ba93286fa8b0690dd"
server_key_iv: "c03522f6b5a53f2b54a166b5b4b237e8"
server_key_version: "encryptionkey@0"
I20260810 21:04:38.944941 21514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:38.951531 21514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:38.953670 21514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:38.953794 21514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:38.954002 21514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:38.954464 21514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:38.954507 21514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:38.954531 21514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:38.954545 21514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:38.960784 21514 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:41413
I20260810 21:04:38.960886 21696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:41413 every 8 connection(s)
I20260810 21:04:38.961251 21514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
Aug 10 21:04:38 dist-test-slave-jq4t krb5kdc[21137](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395878, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:38.969838 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 21514
I20260810 21:04:38.969942 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:04:38.970202 15508 external_mini_cluster.cc:1428] Setting key f752267cf0f842a18318acd0a12cbaf7
I20260810 21:04:38.971597 21272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:38.962079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:43835 (local address 127.15.37.62:43261)
0810 21:04:38.962148 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:38.962150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:38.962376 (+ 226us) server_negotiation.cc:407] Connection header received
0810 21:04:38.963462 (+ 1086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:38.963463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:38.963477 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:38.963547 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:38.964305 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:38.964889 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:38.965937 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:38.966142 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:38.966224 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:38.968538 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:38.968540 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:38.968541 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:38.968550 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:38.969888 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:38.970483 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:38.970485 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:38.970485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:38.970569 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:38.970870 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:38.970872 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:38.970872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:38.971028 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:38.971091 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:38.971402 (+ 311us) server_negotiation.cc:299] Negotiation successful
0810 21:04:38.971493 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 21:04:38.971823 21706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:38.962051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:43261 (local address 127.15.37.2:43835)
0810 21:04:38.962250 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:38.962290 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:38.963347 (+ 1057us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:38.963627 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:38.963632 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:38.963974 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:38.964202 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:38.964207 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:38.964995 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:38.964996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:38.965842 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:38.965844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:38.966232 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:38.966234 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:38.966367 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:38.966959 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:38.966968 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:38.968401 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:38.970017 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:38.970026 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:38.970030 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:38.970395 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:38.970645 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:38.970646 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:38.970647 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:38.970777 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:38.971092 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:38.971102 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:38.971260 (+ 158us) client_negotiation.cc:769] Sending connection context
0810 21:04:38.971381 (+ 121us) client_negotiation.cc:240] Negotiation successful
0810 21:04:38.971562 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":96,"threads_started":1}
I20260810 21:04:38.972357 21700 heartbeater.cc:347] Connected to a master server at 127.15.37.62:43261
I20260810 21:04:38.972498 21700 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:38.972736 21700 heartbeater.cc:511] Master 127.15.37.62:43261 requested a full tablet report, sending...
I20260810 21:04:38.973246 21207 ts_manager.cc:194] Registered new tserver with Master: 885907fb61f14e6184de133729206cfe (127.15.37.2:41413)
I20260810 21:04:38.973650 21207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:43835
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:04:38.999437 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:43261
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:39.087733 21710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:39.087983 21710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:39.088011 21710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:39.089452 21710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:39.089507 21710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:39.089537 21710 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:04:39.091619 21710 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:43261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:39.091876 21710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:39.092113 21710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:39.097879 21720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:39.097908 21716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:39.097879 21717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:39.098191 21710 server_base.cc:1034] running on GCE node
I20260810 21:04:39.098472 21710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:39.098767 21710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:39.100008 21710 hybrid_clock.cc:648] HybridClock initialized: now 1786395879099996 us; error 57 us; skew 500 ppm
Aug 10 21:04:39 dist-test-slave-jq4t krb5kdc[21137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395879, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:39.102926 21710 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:04:39.103402 21710 webserver.cc:460] Webserver started at http://127.15.37.3:44297/ using document root <none> and password file <none>
I20260810 21:04:39.103632 21710 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:39.103677 21710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:39.103773 21710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:39.104957 21710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "c2d190636e5d4a7b8fdface967d53bb2"
format_stamp: "Formatted at 2026-08-10 21:04:39 on dist-test-slave-jq4t"
server_key: "6e976e6ecd1181df6aed7cdcd86641cf"
server_key_iv: "9aaa4145aaec930920cfa56137671127"
server_key_version: "encryptionkey@0"
I20260810 21:04:39.105356 21710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "c2d190636e5d4a7b8fdface967d53bb2"
format_stamp: "Formatted at 2026-08-10 21:04:39 on dist-test-slave-jq4t"
server_key: "6e976e6ecd1181df6aed7cdcd86641cf"
server_key_iv: "9aaa4145aaec930920cfa56137671127"
server_key_version: "encryptionkey@0"
I20260810 21:04:39.106827 21710 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 21:04:39.107594 21731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:39.107802 21710 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:39.107901 21710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "c2d190636e5d4a7b8fdface967d53bb2"
format_stamp: "Formatted at 2026-08-10 21:04:39 on dist-test-slave-jq4t"
server_key: "6e976e6ecd1181df6aed7cdcd86641cf"
server_key_iv: "9aaa4145aaec930920cfa56137671127"
server_key_version: "encryptionkey@0"
I20260810 21:04:39.107977 21710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:39.119216 21710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:39.121773 21710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:39.121908 21710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:39.122128 21710 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:39.122507 21710 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:39.122548 21710 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:39.122572 21710 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:39.122584 21710 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:39.128844 21710 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:42119
I20260810 21:04:39.128925 21893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:42119 every 8 connection(s)
I20260810 21:04:39.129294 21710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:04:39.135948 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 21710
I20260810 21:04:39.136041 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:04:39.136240 15508 external_mini_cluster.cc:1428] Setting key 44bd4444e73babf540c756f6f24c6be5
Aug 10 21:04:39 dist-test-slave-jq4t krb5kdc[21137](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395879, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:39.140157 21272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:39.130282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:54475 (local address 127.15.37.62:43261)
0810 21:04:39.130385 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:39.130388 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:39.130608 (+ 220us) server_negotiation.cc:407] Connection header received
0810 21:04:39.131676 (+ 1068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:39.131678 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:39.131693 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:39.131759 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:39.132500 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:39.133032 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:39.134118 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:39.134323 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:39.134419 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:39.137112 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:39.137113 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:39.137113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:39.137121 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:39.138766 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:39.139250 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:39.139251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:39.139252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:39.139311 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:39.139550 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:39.139551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:39.139551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:39.139670 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:39.139724 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:39.140005 (+ 281us) server_negotiation.cc:299] Negotiation successful
0810 21:04:39.140076 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 21:04:39.140332 21898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:39.130168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:43261 (local address 127.15.37.3:54475)
0810 21:04:39.130419 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:39.130497 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:39.131538 (+ 1041us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:39.131850 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:39.131855 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:39.132160 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:39.132369 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:39.132374 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:39.133150 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:39.133151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:39.134014 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:39.134016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:39.134445 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:39.134446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:39.134593 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:39.135202 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:39.135211 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:39.137001 (+ 1790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:39.138888 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:39.138896 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:39.138898 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:39.139169 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:39.139381 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:39.139382 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:39.139382 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:39.139491 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:39.139727 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:39.139731 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:39.139884 (+ 153us) client_negotiation.cc:769] Sending connection context
0810 21:04:39.139972 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 21:04:39.140109 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":120,"threads_started":1}
I20260810 21:04:39.140825 21895 heartbeater.cc:347] Connected to a master server at 127.15.37.62:43261
I20260810 21:04:39.140954 21895 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:39.141152 21895 heartbeater.cc:511] Master 127.15.37.62:43261 requested a full tablet report, sending...
I20260810 21:04:39.141553 21207 ts_manager.cc:194] Registered new tserver with Master: c2d190636e5d4a7b8fdface967d53bb2 (127.15.37.3:42119)
I20260810 21:04:39.141912 21207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:54475
I20260810 21:04:39.148517 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 21:04:39 dist-test-slave-jq4t krb5kdc[21137](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 21:04:39 dist-test-slave-jq4t krb5kdc[21137](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.1@KRBTEST.COM
I20260810 21:04:39.174634 21904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:39.166303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60452 (local address 127.15.37.1:37699)
0810 21:04:39.166502 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:39.166508 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:39.166519 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:04:39.166551 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:39.166553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:39.166568 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:39.166643 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:39.167262 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:39.168017 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:39.168815 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:39.169146 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:39.169206 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:39.171683 (+ 2477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:39.171696 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:39.171696 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:39.171703 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:39.173547 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:39.173891 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:39.173894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:39.173895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:39.173964 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:39.174148 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:39.174149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:39.174149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:39.174295 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:39.174415 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:39.174481 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 21:04:39.174546 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":104,"threads_started":1}
Aug 10 21:04:39 dist-test-slave-jq4t krb5kdc[21137](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:39.183507 21272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:39.176151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35932 (local address 127.15.37.62:43261)
0810 21:04:39.176212 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:39.176214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:39.176223 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:04:39.176257 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:39.176259 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:39.176269 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:39.176319 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:39.176873 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:39.177404 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:39.178088 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:39.178280 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:39.178339 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:39.180945 (+ 2606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:39.180947 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:39.180947 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:39.180955 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:39.182435 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:39.182797 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:39.182798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:39.182798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:39.182849 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:39.183038 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:39.183038 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:39.183038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:39.183201 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:39.183277 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:39.183370 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 21:04:39.183435 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260810 21:04:39.183825 21207 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35932
I20260810 21:04:39.184319 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 21311
I20260810 21:04:39.203166 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 21514
I20260810 21:04:39.221798 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 21710
I20260810 21:04:39.238229 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 21158
2026-08-10T21:04:39Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2453 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:04:39 dist-test-slave-jq4t krb5kdc[21910](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:04:39 dist-test-slave-jq4t krb5kdc[21910](info): set up 2 sockets
Aug 10 21:04:39 dist-test-slave-jq4t krb5kdc[21910](info): commencing operation
krb5kdc: starting...
W20260810 21:04:40.508345 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:04:40 dist-test-slave-jq4t krb5kdc[21910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:04:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:04:40.641919 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:45905
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:45367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:45905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:40.730877 21928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:40.731113 21928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:40.731138 21928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:40.732409 21928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:40.732457 21928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:40.732499 21928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:40.732514 21928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:40.732573 21928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:40.734242 21928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:45367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:45905
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:45905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:40.734553 21928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:40.734823 21928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:40.740562 21935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:40.740566 21936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:40.740911 21928 server_base.cc:1034] running on GCE node
W20260810 21:04:40.742028 21938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:40.742406 21928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:40.742944 21928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:40.744161 21928 hybrid_clock.cc:648] HybridClock initialized: now 1786395880744132 us; error 42 us; skew 500 ppm
Aug 10 21:04:40 dist-test-slave-jq4t krb5kdc[21910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395880, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:40.747920 21928 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:04:40.748354 21928 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:40.748442 21928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:40.748661 21928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:40.749869 21928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "e6dd593c8229496582a576f2ea79dcea"
format_stamp: "Formatted at 2026-08-10 21:04:40 on dist-test-slave-jq4t"
server_key: "8b7d6d27c1cb63ca66aeb65458adf278"
server_key_iv: "9dec6e390b1e3d70e28dbbc3fc0083ab"
server_key_version: "encryptionkey@0"
I20260810 21:04:40.750281 21928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "e6dd593c8229496582a576f2ea79dcea"
format_stamp: "Formatted at 2026-08-10 21:04:40 on dist-test-slave-jq4t"
server_key: "8b7d6d27c1cb63ca66aeb65458adf278"
server_key_iv: "9dec6e390b1e3d70e28dbbc3fc0083ab"
server_key_version: "encryptionkey@0"
I20260810 21:04:40.751786 21928 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:40.752712 21945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:40.752955 21928 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:40.753065 21928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "e6dd593c8229496582a576f2ea79dcea"
format_stamp: "Formatted at 2026-08-10 21:04:40 on dist-test-slave-jq4t"
server_key: "8b7d6d27c1cb63ca66aeb65458adf278"
server_key_iv: "9dec6e390b1e3d70e28dbbc3fc0083ab"
server_key_version: "encryptionkey@0"
I20260810 21:04:40.753154 21928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:40.769035 21928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:40.771749 21928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:40.771941 21928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:40.776412 21928 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:45905
I20260810 21:04:40.776449 22026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:45905 every 8 connection(s)
I20260810 21:04:40.776799 21928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:40.778028 22028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:40.778368 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 21928
I20260810 21:04:40.778509 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:40.778692 15508 external_mini_cluster.cc:1428] Setting key a157470debe149e04c849c7e7287d852
I20260810 21:04:40.781986 22028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea: Bootstrap starting.
I20260810 21:04:40.782850 22028 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:40.783171 22028 log.cc:824] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:40.784168 22028 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea: No bootstrap required, opened a new log
Aug 10 21:04:40 dist-test-slave-jq4t krb5kdc[21910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:40.786865 22028 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6dd593c8229496582a576f2ea79dcea" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 45905 } }
I20260810 21:04:40.787067 22028 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:40.787117 22028 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6dd593c8229496582a576f2ea79dcea, State: Initialized, Role: FOLLOWER
I20260810 21:04:40.787262 22028 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6dd593c8229496582a576f2ea79dcea" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 45905 } }
I20260810 21:04:40.787365 22028 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:40.787421 22028 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:40.787472 22028 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:40.790781 22031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:40.779318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40748 (local address 127.15.37.62:45905)
0810 21:04:40.779496 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:40.779504 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:40.779531 (+ 27us) server_negotiation.cc:407] Connection header received
0810 21:04:40.780120 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:40.780128 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:40.780178 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:40.780297 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:40.781199 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:40.782189 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:40.783317 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:40.783773 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:40.783875 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:40.786761 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:40.786771 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:40.786771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:40.786785 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:40.788974 (+ 2189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:40.789449 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:40.789453 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:40.789453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:40.789557 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:40.789797 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:40.789798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:40.789798 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:40.790096 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:40.790279 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:40.790402 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 21:04:40.790570 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":89,"threads_started":1}
I20260810 21:04:40.807978 22028 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6dd593c8229496582a576f2ea79dcea" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 45905 } }
I20260810 21:04:40.808271 22028 leader_election.cc:302] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6dd593c8229496582a576f2ea79dcea; no voters:
I20260810 21:04:40.808641 22028 leader_election.cc:288] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:40.809278 22028 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:40.808687 22035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:40.809525 22035 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [term 1 LEADER]: Becoming Leader. State: Replica: e6dd593c8229496582a576f2ea79dcea, State: Running, Role: LEADER
I20260810 21:04:40.809669 22035 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6dd593c8229496582a576f2ea79dcea" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 45905 } }
I20260810 21:04:40.810469 22037 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6dd593c8229496582a576f2ea79dcea. Latest consensus state: current_term: 1 leader_uuid: "e6dd593c8229496582a576f2ea79dcea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6dd593c8229496582a576f2ea79dcea" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 45905 } } }
I20260810 21:04:40.810685 22036 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6dd593c8229496582a576f2ea79dcea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6dd593c8229496582a576f2ea79dcea" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 45905 } } }
I20260810 21:04:40.810706 22037 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:40.810788 22036 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:40.811280 22058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:40.811847 22058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:40.813903 22058 catalog_manager.cc:1347] Generated new cluster ID: eb66246cd6ae4c17b4787befb46b812d
I20260810 21:04:40.813972 22058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:04:40.834959 22058 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:40.835623 22058 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:40.839694 22058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea: Generated new TSK 0
I20260810 21:04:40.839956 22058 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
W20260810 21:04:41.698963 15508 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.15.37.1: real 0.857s user 0.001s sys 0.003s
I20260810 21:04:41.699431 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:45905
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:45367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:41.789319 22064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:41.789604 22064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:41.789649 22064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:41.790913 22064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:41.791004 22064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:41.791057 22064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:04:41.792837 22064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:45367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:45905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:41.793175 22064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:41.793443 22064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 21:04:41.798966 22064 server_base.cc:1034] running on GCE node
W20260810 21:04:41.798960 22074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:41.798949 22072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:41.798949 22076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:41.799525 22064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:41.799853 22064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:41.801031 22064 hybrid_clock.cc:648] HybridClock initialized: now 1786395881801002 us; error 53 us; skew 500 ppm
Aug 10 21:04:41 dist-test-slave-jq4t krb5kdc[21910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395881, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:41.808730 22064 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:04:41.809201 22064 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:41.809279 22064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:41.809449 22064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:41.810734 22064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "45da69923df34aeabc8d81da186fc4d0"
format_stamp: "Formatted at 2026-08-10 21:04:41 on dist-test-slave-jq4t"
server_key: "8c62572bdb7e620df6b3433ba96822fd"
server_key_iv: "6bc2bbfbe2fa46b5a98d289f40dd55d2"
server_key_version: "encryptionkey@0"
I20260810 21:04:41.811141 22064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "45da69923df34aeabc8d81da186fc4d0"
format_stamp: "Formatted at 2026-08-10 21:04:41 on dist-test-slave-jq4t"
server_key: "8c62572bdb7e620df6b3433ba96822fd"
server_key_iv: "6bc2bbfbe2fa46b5a98d289f40dd55d2"
server_key_version: "encryptionkey@0"
I20260810 21:04:41.812618 22064 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260810 21:04:41.813436 22083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:41.813643 22064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:41.813745 22064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "45da69923df34aeabc8d81da186fc4d0"
format_stamp: "Formatted at 2026-08-10 21:04:41 on dist-test-slave-jq4t"
server_key: "8c62572bdb7e620df6b3433ba96822fd"
server_key_iv: "6bc2bbfbe2fa46b5a98d289f40dd55d2"
server_key_version: "encryptionkey@0"
I20260810 21:04:41.813804 22064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:41.831476 22064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:41.833973 22064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:41.834116 22064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:41.834394 22064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:41.834951 22064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:41.835026 22064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:41.835068 22064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:41.835099 22064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:41.841643 22064 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:43795
I20260810 21:04:41.841718 22257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:43795 every 8 connection(s)
I20260810 21:04:41.842064 22064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:04:41.846514 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 22064
I20260810 21:04:41.846657 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:04:41.846904 15508 external_mini_cluster.cc:1428] Setting key a6487d01f1544827dc996911834208d7
Aug 10 21:04:41 dist-test-slave-jq4t krb5kdc[21910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395881, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:41.854579 22261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:41.843112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:45489 (local address 127.15.37.62:45905)
0810 21:04:41.844628 (+ 1516us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:41.844630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:41.844639 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:04:41.844666 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:41.844667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:41.844678 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:41.844739 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:41.846329 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:41.847238 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:41.848472 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:41.848849 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:41.848930 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:41.851303 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:41.851305 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:41.851306 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:41.851312 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:41.853010 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:41.853481 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:41.853483 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:41.853483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:41.853554 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:41.853827 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:41.853828 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:41.853829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:41.853970 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:41.854048 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:41.854373 (+ 325us) server_negotiation.cc:299] Negotiation successful
0810 21:04:41.854475 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1490,"thread_start_us":60,"threads_started":1}
I20260810 21:04:41.854787 22262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:41.843094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:45905 (local address 127.15.37.1:45489)
0810 21:04:41.843285 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:41.843326 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:41.843863 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:41.844862 (+ 999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:41.844867 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:41.845317 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:41.846171 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:41.846179 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:41.847374 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:41.847375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:41.848367 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:41.848370 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:41.848937 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:41.848938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:41.849064 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:41.849706 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:41.849715 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:41.851177 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:41.853110 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:41.853120 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:41.853123 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:41.853396 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:41.853633 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:41.853634 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:41.853634 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:41.853755 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:41.854052 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:41.854061 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:41.854216 (+ 155us) client_negotiation.cc:769] Sending connection context
0810 21:04:41.854329 (+ 113us) client_negotiation.cc:240] Negotiation successful
0810 21:04:41.854515 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":87,"threads_started":1}
I20260810 21:04:41.855439 22258 heartbeater.cc:347] Connected to a master server at 127.15.37.62:45905
I20260810 21:04:41.855574 22258 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:41.855782 22258 heartbeater.cc:511] Master 127.15.37.62:45905 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
I20260810 21:04:41.856941 21975 ts_manager.cc:194] Registered new tserver with Master: 45da69923df34aeabc8d81da186fc4d0 (127.15.37.1:43795)
I20260810 21:04:41.857615 21975 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:45489
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
W20260810 21:04:42.541884 15508 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.15.37.2: real 0.694s user 0.000s sys 0.004s
I20260810 21:04:42.542308 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:45905
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:45367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:42.628756 22268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:42.629001 22268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:42.629029 22268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:42.630214 22268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:42.630255 22268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:42.630283 22268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:04:42.631860 22268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:45367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:45905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:42.632086 22268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:42.632282 22268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:42.637635 22275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:42.637630 22279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:42.637647 22273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:42.637863 22268 server_base.cc:1034] running on GCE node
I20260810 21:04:42.638139 22268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:42.638406 22268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:42.639598 22268 hybrid_clock.cc:648] HybridClock initialized: now 1786395882639584 us; error 32 us; skew 500 ppm
Aug 10 21:04:42 dist-test-slave-jq4t krb5kdc[21910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395882, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:42.642354 22268 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:04:42.642663 22268 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:42.642709 22268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:42.642804 22268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:42.643882 22268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "69ce7242a3f64d708f6008a6600b4164"
format_stamp: "Formatted at 2026-08-10 21:04:42 on dist-test-slave-jq4t"
server_key: "df45d6cfe261737b6be860f25c1ee375"
server_key_iv: "9d3f92d5ac63d0bb1afc8c35ccfa233a"
server_key_version: "encryptionkey@0"
I20260810 21:04:42.644210 22268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "69ce7242a3f64d708f6008a6600b4164"
format_stamp: "Formatted at 2026-08-10 21:04:42 on dist-test-slave-jq4t"
server_key: "df45d6cfe261737b6be860f25c1ee375"
server_key_iv: "9d3f92d5ac63d0bb1afc8c35ccfa233a"
server_key_version: "encryptionkey@0"
I20260810 21:04:42.645625 22268 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:04:42.646368 22290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:42.646549 22268 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 21:04:42.646647 22268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "69ce7242a3f64d708f6008a6600b4164"
format_stamp: "Formatted at 2026-08-10 21:04:42 on dist-test-slave-jq4t"
server_key: "df45d6cfe261737b6be860f25c1ee375"
server_key_iv: "9d3f92d5ac63d0bb1afc8c35ccfa233a"
server_key_version: "encryptionkey@0"
I20260810 21:04:42.646706 22268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:42.655206 22268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:42.657678 22268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:42.657801 22268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:42.658015 22268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:42.658376 22268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:42.658416 22268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:42.658442 22268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:42.658453 22268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:42.664395 22268 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:35963
I20260810 21:04:42.664527 22443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:35963 every 8 connection(s)
I20260810 21:04:42.664830 22268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:04:42.668438 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 22268
I20260810 21:04:42.668604 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:04:42.668792 15508 external_mini_cluster.cc:1428] Setting key f56ffce5c84b595141c24ad87634c95f
Aug 10 21:04:42 dist-test-slave-jq4t krb5kdc[21910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395882, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:42.675202 22446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:42.665649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:53557 (local address 127.15.37.62:45905)
0810 21:04:42.665792 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:42.665794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:42.666028 (+ 234us) server_negotiation.cc:407] Connection header received
0810 21:04:42.666523 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:42.666524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:42.666537 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:42.666607 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:42.667584 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.668113 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.669342 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.669568 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.669662 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:42.671999 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:42.672002 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:42.672002 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:42.672010 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:42.673636 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:42.674096 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:42.674098 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:42.674098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:42.674174 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:42.674454 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:42.674455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:42.674455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:42.674593 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:42.674672 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:42.674990 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 21:04:42.675099 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":58,"threads_started":1}
I20260810 21:04:42.675392 22447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:42.665660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:45905 (local address 127.15.37.2:53557)
0810 21:04:42.665853 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:42.665894 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:42.666433 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:42.666689 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:42.666693 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:42.666971 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:42.667504 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:42.667509 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.668197 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.668198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:42.669248 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:42.669251 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.669688 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.669689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:42.669828 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:42.670392 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:42.670401 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:42.671891 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:42.673737 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:42.673745 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:42.673748 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:42.674006 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:42.674254 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:42.674255 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:42.674255 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:42.674380 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:42.674675 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:42.674684 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:42.674843 (+ 159us) client_negotiation.cc:769] Sending connection context
0810 21:04:42.674954 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 21:04:42.675127 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":104,"threads_started":1}
I20260810 21:04:42.675933 22444 heartbeater.cc:347] Connected to a master server at 127.15.37.62:45905
I20260810 21:04:42.676061 22444 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:42.676242 22444 heartbeater.cc:511] Master 127.15.37.62:45905 requested a full tablet report, sending...
I20260810 21:04:42.676726 21975 ts_manager.cc:194] Registered new tserver with Master: 69ce7242a3f64d708f6008a6600b4164 (127.15.37.2:35963)
I20260810 21:04:42.677284 21975 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:53557
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:04:42.699306 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:45905
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:45367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:42.786193 22450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:42.786425 22450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:42.786450 22450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:42.787560 22450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:42.787593 22450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:42.787619 22450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:04:42.789197 22450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:45367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:45905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:42.789423 22450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:42.789626 22450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 21:04:42.795183 22450 server_base.cc:1034] running on GCE node
W20260810 21:04:42.795087 22455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:42.795089 22456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:42.795089 22460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:42.795581 22450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:42.795855 22450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:42.797092 22450 hybrid_clock.cc:648] HybridClock initialized: now 1786395882797075 us; error 43 us; skew 500 ppm
Aug 10 21:04:42 dist-test-slave-jq4t krb5kdc[21910](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395882, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:42.799753 22450 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:04:42.800092 22450 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:42.800139 22450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:42.800235 22450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:42.801352 22450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "e969495c1da941d98b1fcc5f81076b04"
format_stamp: "Formatted at 2026-08-10 21:04:42 on dist-test-slave-jq4t"
server_key: "52cc8fb98c840e3466ff977c6858caa1"
server_key_iv: "6a6dcc545b25d5bc3a28d011ac70a228"
server_key_version: "encryptionkey@0"
I20260810 21:04:42.801678 22450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "e969495c1da941d98b1fcc5f81076b04"
format_stamp: "Formatted at 2026-08-10 21:04:42 on dist-test-slave-jq4t"
server_key: "52cc8fb98c840e3466ff977c6858caa1"
server_key_iv: "6a6dcc545b25d5bc3a28d011ac70a228"
server_key_version: "encryptionkey@0"
I20260810 21:04:42.803140 22450 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 21:04:42.803948 22468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:42.804160 22450 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:42.804258 22450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "e969495c1da941d98b1fcc5f81076b04"
format_stamp: "Formatted at 2026-08-10 21:04:42 on dist-test-slave-jq4t"
server_key: "52cc8fb98c840e3466ff977c6858caa1"
server_key_iv: "6a6dcc545b25d5bc3a28d011ac70a228"
server_key_version: "encryptionkey@0"
I20260810 21:04:42.804322 22450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:42.830533 22450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:42.833127 22450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:42.833253 22450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:42.833469 22450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:42.833850 22450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:42.833897 22450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:42.833923 22450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:42.833936 22450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:42.840032 22450 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:40773
I20260810 21:04:42.840106 22627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:40773 every 8 connection(s)
I20260810 21:04:42.840405 22450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:04:42.845937 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 22450
I20260810 21:04:42.846083 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:04:42.846288 15508 external_mini_cluster.cc:1428] Setting key 78e6a593a6ae241e4cd5bd564272e08b
Aug 10 21:04:42 dist-test-slave-jq4t krb5kdc[21910](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395882, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:42.850932 22446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:42.841181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:43973 (local address 127.15.37.62:45905)
0810 21:04:42.841237 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:42.841239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:42.841434 (+ 195us) server_negotiation.cc:407] Connection header received
0810 21:04:42.841978 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:42.841980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:42.841996 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:42.842068 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:42.843112 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.843664 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.844727 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.844945 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.845034 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:42.847657 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:42.847658 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:42.847658 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:42.847667 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:42.849421 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:42.849934 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:42.849935 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:42.849935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:42.849997 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:42.850226 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:42.850227 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:42.850228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:42.850354 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:42.850411 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:42.850713 (+ 302us) server_negotiation.cc:299] Negotiation successful
0810 21:04:42.850840 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 21:04:42.851157 22631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:42.841145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:45905 (local address 127.15.37.3:43973)
0810 21:04:42.841297 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:42.841344 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:42.841864 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:42.842145 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:42.842149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:42.842437 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:42.842975 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:42.842981 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.843768 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.843769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:42.844626 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:42.844628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.845045 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.845047 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:42.845187 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:42.845738 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:42.845752 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:42.847537 (+ 1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:42.849557 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:42.849567 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:42.849570 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:42.849824 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:42.850056 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:42.850057 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:42.850057 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:42.850165 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:42.850415 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:42.850420 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:42.850549 (+ 129us) client_negotiation.cc:769] Sending connection context
0810 21:04:42.850672 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 21:04:42.850881 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":67,"threads_started":1}
I20260810 21:04:42.851650 22628 heartbeater.cc:347] Connected to a master server at 127.15.37.62:45905
I20260810 21:04:42.851754 22628 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:42.851958 22628 heartbeater.cc:511] Master 127.15.37.62:45905 requested a full tablet report, sending...
I20260810 21:04:42.852358 21975 ts_manager.cc:194] Registered new tserver with Master: e969495c1da941d98b1fcc5f81076b04 (127.15.37.3:40773)
I20260810 21:04:42.852784 21975 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:43973
I20260810 21:04:42.858398 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:04:42.858736 22258 heartbeater.cc:503] Master 127.15.37.62:45905 was elected leader, sending a full tablet report...
I20260810 21:04:42.866196 22446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:42.859911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40752 (local address 127.15.37.62:45905)
0810 21:04:42.859992 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:42.859995 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:42.860099 (+ 104us) server_negotiation.cc:407] Connection header received
0810 21:04:42.860188 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:42.860189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:42.860201 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:42.860275 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:42.860922 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.861425 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.862175 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.862370 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.862446 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:42.863614 (+ 1168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:42.863616 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:42.863616 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:42.863625 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:42.864926 (+ 1301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:42.865297 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:42.865298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:42.865298 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:42.865358 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:42.865575 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:42.865576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:42.865576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:42.865733 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:42.865844 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:42.865996 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 21:04:42.866085 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 21:04:42.867879 21975 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40752:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:42.869654 21975 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:42.876646 22650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:42.872423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:35963 (local address 127.0.0.1:47596)
0810 21:04:42.872673 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:42.872720 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:42.872790 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:42.873035 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:42.873045 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:42.873048 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:42.873129 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:42.873131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.874582 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.874583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:42.875625 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:42.875627 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.876316 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.876317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:42.876400 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:42.876415 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 21:04:42.876509 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 21:04:42.876572 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":113,"threads_started":1}
I20260810 21:04:42.876659 22651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:42.872548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47596 (local address 127.15.37.2:35963)
0810 21:04:42.872759 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:42.872764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:42.872777 (+ 13us) server_negotiation.cc:407] Connection header received
0810 21:04:42.872891 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:42.872893 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:42.872913 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:42.873013 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:42.873325 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.874471 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.875714 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.876224 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.876317 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:42.876384 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:42.876526 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 21:04:42.876569 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":91,"threads_started":1}
I20260810 21:04:42.877039 22652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:42.872660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52996 (local address 127.15.37.3:40773)
0810 21:04:42.872961 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:42.872965 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:42.872997 (+ 32us) server_negotiation.cc:407] Connection header received
0810 21:04:42.873044 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:42.873046 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:42.873062 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:42.873144 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:42.873360 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.874110 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.875600 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.876357 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.876433 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:42.876516 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:42.876915 (+ 399us) server_negotiation.cc:299] Negotiation successful
0810 21:04:42.876964 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":89,"threads_started":1}
I20260810 21:04:42.876807 22655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:42.872458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:40773 (local address 127.0.0.1:52996)
0810 21:04:42.872929 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:42.872942 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:42.872989 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:42.873228 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:42.873229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:42.873230 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:42.873278 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:42.873279 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.874218 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.874219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:42.875504 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:42.875506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.876556 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.876558 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:42.876628 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:42.876633 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:04:42.876682 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 21:04:42.876725 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":403,"threads_started":1}
I20260810 21:04:42.876927 22647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:42.872514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:43795 (local address 127.0.0.1:52342)
0810 21:04:42.873069 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:42.873078 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:42.873114 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:42.873410 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:42.873411 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:42.873413 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:42.873456 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:42.873457 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.874744 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.874744 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:42.875727 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:42.875729 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.876678 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.876678 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:42.876731 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:42.876734 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:04:42.876763 (+ 29us) client_negotiation.cc:240] Negotiation successful
0810 21:04:42.876795 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"mutex_wait_us":1,"thread_start_us":100,"threads_started":1}
I20260810 21:04:42.877070 22654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:42.872771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52342 (local address 127.15.37.1:43795)
0810 21:04:42.873237 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:42.873241 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:42.873252 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:04:42.873287 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:42.873289 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:42.873305 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:42.873532 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:42.873600 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.874658 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.875832 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:42.876583 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:42.876859 (+ 276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:42.876931 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:42.876955 (+ 24us) server_negotiation.cc:299] Negotiation successful
0810 21:04:42.876992 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":65,"threads_started":1}
I20260810 21:04:42.877929 22357 tablet_service.cc:1467] Processing CreateTablet for tablet 33f0528954c041a794daaee0c7514248 (DEFAULT_TABLE table=test-table [id=2ca63852db0b49268dcbae316d50199d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:42.878101 22542 tablet_service.cc:1467] Processing CreateTablet for tablet 33f0528954c041a794daaee0c7514248 (DEFAULT_TABLE table=test-table [id=2ca63852db0b49268dcbae316d50199d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:42.878129 22163 tablet_service.cc:1467] Processing CreateTablet for tablet 33f0528954c041a794daaee0c7514248 (DEFAULT_TABLE table=test-table [id=2ca63852db0b49268dcbae316d50199d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:42.878357 22357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33f0528954c041a794daaee0c7514248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:42.878376 22542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33f0528954c041a794daaee0c7514248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:42.878409 22163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33f0528954c041a794daaee0c7514248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:42.881132 22656 tablet_bootstrap.cc:492] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0: Bootstrap starting.
I20260810 21:04:42.881688 22659 tablet_bootstrap.cc:492] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164: Bootstrap starting.
I20260810 21:04:42.881975 22656 tablet_bootstrap.cc:654] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:42.881966 22660 tablet_bootstrap.cc:492] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04: Bootstrap starting.
I20260810 21:04:42.882336 22656 log.cc:824] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:42.882412 22659 tablet_bootstrap.cc:654] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:42.882596 22660 tablet_bootstrap.cc:654] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:42.883137 22659 log.cc:824] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:42.883183 22660 log.cc:824] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:42.883322 22656 tablet_bootstrap.cc:492] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0: No bootstrap required, opened a new log
I20260810 21:04:42.883416 22656 ts_tablet_manager.cc:1397] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:04:42.884021 22660 tablet_bootstrap.cc:492] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04: No bootstrap required, opened a new log
I20260810 21:04:42.884164 22660 ts_tablet_manager.cc:1397] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:04:42.884227 22659 tablet_bootstrap.cc:492] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164: No bootstrap required, opened a new log
I20260810 21:04:42.884301 22659 ts_tablet_manager.cc:1397] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:04:42.885684 22660 raft_consensus.cc:348] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ce7242a3f64d708f6008a6600b4164" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35963 } } peers { permanent_uuid: "e969495c1da941d98b1fcc5f81076b04" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40773 } } peers { permanent_uuid: "45da69923df34aeabc8d81da186fc4d0" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43795 } }
I20260810 21:04:42.885861 22660 raft_consensus.cc:374] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:42.885929 22660 raft_consensus.cc:729] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e969495c1da941d98b1fcc5f81076b04, State: Initialized, Role: FOLLOWER
I20260810 21:04:42.886089 22660 consensus_queue.cc:260] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ce7242a3f64d708f6008a6600b4164" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35963 } } peers { permanent_uuid: "e969495c1da941d98b1fcc5f81076b04" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40773 } } peers { permanent_uuid: "45da69923df34aeabc8d81da186fc4d0" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43795 } }
I20260810 21:04:42.886428 22628 heartbeater.cc:503] Master 127.15.37.62:45905 was elected leader, sending a full tablet report...
I20260810 21:04:42.886438 22660 ts_tablet_manager.cc:1428] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:04:42.886554 22659 raft_consensus.cc:348] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ce7242a3f64d708f6008a6600b4164" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35963 } } peers { permanent_uuid: "e969495c1da941d98b1fcc5f81076b04" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40773 } } peers { permanent_uuid: "45da69923df34aeabc8d81da186fc4d0" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43795 } }
I20260810 21:04:42.886734 22659 raft_consensus.cc:374] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:42.886662 22656 raft_consensus.cc:348] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ce7242a3f64d708f6008a6600b4164" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35963 } } peers { permanent_uuid: "e969495c1da941d98b1fcc5f81076b04" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40773 } } peers { permanent_uuid: "45da69923df34aeabc8d81da186fc4d0" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43795 } }
I20260810 21:04:42.886781 22659 raft_consensus.cc:729] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69ce7242a3f64d708f6008a6600b4164, State: Initialized, Role: FOLLOWER
I20260810 21:04:42.886801 22656 raft_consensus.cc:374] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:42.886833 22656 raft_consensus.cc:729] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45da69923df34aeabc8d81da186fc4d0, State: Initialized, Role: FOLLOWER
I20260810 21:04:42.886917 22659 consensus_queue.cc:260] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ce7242a3f64d708f6008a6600b4164" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35963 } } peers { permanent_uuid: "e969495c1da941d98b1fcc5f81076b04" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40773 } } peers { permanent_uuid: "45da69923df34aeabc8d81da186fc4d0" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43795 } }
I20260810 21:04:42.886961 22656 consensus_queue.cc:260] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ce7242a3f64d708f6008a6600b4164" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35963 } } peers { permanent_uuid: "e969495c1da941d98b1fcc5f81076b04" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40773 } } peers { permanent_uuid: "45da69923df34aeabc8d81da186fc4d0" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43795 } }
I20260810 21:04:42.887214 22656 ts_tablet_manager.cc:1428] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 21:04:42.887229 22659 ts_tablet_manager.cc:1428] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:04:42.887383 22444 heartbeater.cc:503] Master 127.15.37.62:45905 was elected leader, sending a full tablet report...
W20260810 21:04:42.915540 22445 tablet.cc:2369] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:04:43.091045 22630 tablet.cc:2369] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:04:43.093421 22260 tablet.cc:2369] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:04:43.188072 22672 raft_consensus.cc:482] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:43.188290 22672 raft_consensus.cc:504] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ce7242a3f64d708f6008a6600b4164" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35963 } } peers { permanent_uuid: "e969495c1da941d98b1fcc5f81076b04" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40773 } } peers { permanent_uuid: "45da69923df34aeabc8d81da186fc4d0" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43795 } }
I20260810 21:04:43.188747 22672 leader_election.cc:288] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69ce7242a3f64d708f6008a6600b4164 (127.15.37.2:35963), e969495c1da941d98b1fcc5f81076b04 (127.15.37.3:40773)
I20260810 21:04:43.192034 22651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.189121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:53809 (local address 127.15.37.2:35963)
0810 21:04:43.189170 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:43.189172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:43.189341 (+ 169us) server_negotiation.cc:407] Connection header received
0810 21:04:43.189418 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:43.189419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:43.189432 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:43.189510 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:43.189689 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:43.190176 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:43.191291 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:43.191675 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:43.191760 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:43.191772 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:43.191924 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 21:04:43.191962 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 21:04:43.192049 22674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.188998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:35963 (local address 127.15.37.1:53809)
0810 21:04:43.189254 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:43.189264 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:43.189359 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:43.189513 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:43.189514 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:43.189516 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:43.189615 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:43.189617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:43.190276 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:43.190277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:43.191190 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:43.191192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:43.191762 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:43.191763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:43.191844 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:43.191847 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:04:43.191917 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 21:04:43.191960 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":131,"thread_start_us":93,"threads_started":1}
I20260810 21:04:43.192150 22652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.189092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:34315 (local address 127.15.37.3:40773)
0810 21:04:43.189164 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:43.189166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:43.189337 (+ 171us) server_negotiation.cc:407] Connection header received
0810 21:04:43.189401 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:43.189402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:43.189415 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:43.189493 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:43.189684 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:43.190167 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:43.191294 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:43.191780 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:43.191873 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:43.191883 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:43.192050 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 21:04:43.192086 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 21:04:43.192173 22673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.188998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:40773 (local address 127.15.37.1:34315)
0810 21:04:43.189222 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:43.189234 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:43.189338 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:43.189498 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:43.189500 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:43.189502 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:43.189599 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:43.189601 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:43.190265 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:43.190266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:43.191190 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:43.191193 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:43.191875 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:43.191876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:43.191962 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:43.191965 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:04:43.192031 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 21:04:43.192075 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":35,"thread_start_us":115,"threads_started":1}
I20260810 21:04:43.192608 22571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33f0528954c041a794daaee0c7514248" candidate_uuid: "45da69923df34aeabc8d81da186fc4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e969495c1da941d98b1fcc5f81076b04" is_pre_election: true
I20260810 21:04:43.192612 22382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33f0528954c041a794daaee0c7514248" candidate_uuid: "45da69923df34aeabc8d81da186fc4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ce7242a3f64d708f6008a6600b4164" is_pre_election: true
I20260810 21:04:43.192777 22571 raft_consensus.cc:2454] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45da69923df34aeabc8d81da186fc4d0 in term 0.
I20260810 21:04:43.192793 22382 raft_consensus.cc:2454] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45da69923df34aeabc8d81da186fc4d0 in term 0.
I20260810 21:04:43.193046 22090 leader_election.cc:302] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45da69923df34aeabc8d81da186fc4d0, 69ce7242a3f64d708f6008a6600b4164; no voters:
I20260810 21:04:43.193188 22672 raft_consensus.cc:2781] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:43.193249 22672 raft_consensus.cc:482] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:43.193272 22672 raft_consensus.cc:3037] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:43.193970 22672 raft_consensus.cc:504] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ce7242a3f64d708f6008a6600b4164" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35963 } } peers { permanent_uuid: "e969495c1da941d98b1fcc5f81076b04" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40773 } } peers { permanent_uuid: "45da69923df34aeabc8d81da186fc4d0" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43795 } }
I20260810 21:04:43.194132 22672 leader_election.cc:288] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [CANDIDATE]: Term 1 election: Requested vote from peers 69ce7242a3f64d708f6008a6600b4164 (127.15.37.2:35963), e969495c1da941d98b1fcc5f81076b04 (127.15.37.3:40773)
I20260810 21:04:43.194321 22382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33f0528954c041a794daaee0c7514248" candidate_uuid: "45da69923df34aeabc8d81da186fc4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69ce7242a3f64d708f6008a6600b4164"
I20260810 21:04:43.194324 22571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33f0528954c041a794daaee0c7514248" candidate_uuid: "45da69923df34aeabc8d81da186fc4d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e969495c1da941d98b1fcc5f81076b04"
I20260810 21:04:43.194419 22571 raft_consensus.cc:3037] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:43.194423 22382 raft_consensus.cc:3037] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:43.195182 22382 raft_consensus.cc:2454] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45da69923df34aeabc8d81da186fc4d0 in term 1.
I20260810 21:04:43.195230 22571 raft_consensus.cc:2454] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45da69923df34aeabc8d81da186fc4d0 in term 1.
I20260810 21:04:43.195386 22090 leader_election.cc:302] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45da69923df34aeabc8d81da186fc4d0, 69ce7242a3f64d708f6008a6600b4164; no voters:
I20260810 21:04:43.195485 22672 raft_consensus.cc:2781] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:43.195658 22672 raft_consensus.cc:686] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [term 1 LEADER]: Becoming Leader. State: Replica: 45da69923df34aeabc8d81da186fc4d0, State: Running, Role: LEADER
I20260810 21:04:43.195801 22672 consensus_queue.cc:237] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ce7242a3f64d708f6008a6600b4164" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35963 } } peers { permanent_uuid: "e969495c1da941d98b1fcc5f81076b04" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40773 } } peers { permanent_uuid: "45da69923df34aeabc8d81da186fc4d0" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43795 } }
I20260810 21:04:43.196789 21975 catalog_manager.cc:5495] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45da69923df34aeabc8d81da186fc4d0 (127.15.37.1). New cstate: current_term: 1 leader_uuid: "45da69923df34aeabc8d81da186fc4d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69ce7242a3f64d708f6008a6600b4164" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e969495c1da941d98b1fcc5f81076b04" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45da69923df34aeabc8d81da186fc4d0" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43795 } health_report { overall_health: HEALTHY } } }
I20260810 21:04:43.231932 22654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.229440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52350 (local address 127.15.37.1:43795)
0810 21:04:43.229506 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:43.229508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:43.229517 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:04:43.229574 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:43.229575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:43.229601 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:43.229668 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:43.229830 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:43.230311 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:43.231159 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:43.231366 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:43.231435 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:43.231600 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:43.231717 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:43.231782 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:43.231822 (+ 40us) server_negotiation.cc:299] Negotiation successful
0810 21:04:43.231846 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 21:04:43.234026 22382 raft_consensus.cc:1261] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164 [term 1 FOLLOWER]: Refusing update from remote peer 45da69923df34aeabc8d81da186fc4d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:43.234035 22571 raft_consensus.cc:1261] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04 [term 1 FOLLOWER]: Refusing update from remote peer 45da69923df34aeabc8d81da186fc4d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:43.234452 22675 consensus_queue.cc:1035] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69ce7242a3f64d708f6008a6600b4164" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:43.234601 22672 consensus_queue.cc:1035] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e969495c1da941d98b1fcc5f81076b04" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:43.240267 21973 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:43.240404 21973 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:43.241357 21973 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6dd593c8229496582a576f2ea79dcea: Sending DeleteTablet for 3 replicas of tablet 33f0528954c041a794daaee0c7514248
I20260810 21:04:43.241742 22542 tablet_service.cc:1514] Processing DeleteTablet for tablet 33f0528954c041a794daaee0c7514248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:43 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:52996
I20260810 21:04:43.241786 22357 tablet_service.cc:1514] Processing DeleteTablet for tablet 33f0528954c041a794daaee0c7514248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:43 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:47596
I20260810 21:04:43.241994 22163 tablet_service.cc:1514] Processing DeleteTablet for tablet 33f0528954c041a794daaee0c7514248 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:43 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:52342
I20260810 21:04:43.242237 22696 tablet_replica.cc:330] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0: stopping tablet replica
I20260810 21:04:43.242367 22696 raft_consensus.cc:2229] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:04:43.242530 22694 tablet_replica.cc:330] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04: stopping tablet replica
I20260810 21:04:43.242594 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 22064
I20260810 21:04:43.242554 22696 raft_consensus.cc:2258] T 33f0528954c041a794daaee0c7514248 P 45da69923df34aeabc8d81da186fc4d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:43.242647 22694 raft_consensus.cc:2229] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:43.242756 22694 raft_consensus.cc:2258] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:43.243016 22695 tablet_replica.cc:330] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164: stopping tablet replica
I20260810 21:04:43.243120 22695 raft_consensus.cc:2229] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:43.243227 22695 raft_consensus.cc:2258] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:43.243703 22695 ts_tablet_manager.cc:1905] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:43.246145 22695 ts_tablet_manager.cc:1918] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:43.246218 22695 log.cc:1196] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/33f0528954c041a794daaee0c7514248
I20260810 21:04:43.246443 22695 ts_tablet_manager.cc:1939] T 33f0528954c041a794daaee0c7514248 P 69ce7242a3f64d708f6008a6600b4164: Deleting consensus metadata
I20260810 21:04:43.248075 21951 catalog_manager.cc:4841] TS 69ce7242a3f64d708f6008a6600b4164 (127.15.37.2:35963): tablet 33f0528954c041a794daaee0c7514248 (table test-table [id=2ca63852db0b49268dcbae316d50199d]) successfully deleted
I20260810 21:04:43.253332 22694 ts_tablet_manager.cc:1905] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:43.256983 22694 ts_tablet_manager.cc:1918] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:43.257087 22694 log.cc:1196] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/33f0528954c041a794daaee0c7514248
I20260810 21:04:43.257411 22694 ts_tablet_manager.cc:1939] T 33f0528954c041a794daaee0c7514248 P e969495c1da941d98b1fcc5f81076b04: Deleting consensus metadata
I20260810 21:04:43.257990 21946 catalog_manager.cc:4841] TS e969495c1da941d98b1fcc5f81076b04 (127.15.37.3:40773): tablet 33f0528954c041a794daaee0c7514248 (table test-table [id=2ca63852db0b49268dcbae316d50199d]) successfully deleted
W20260810 21:04:43.261925 21948 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:43795 (error 108)
I20260810 21:04:43.262115 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 22268
I20260810 21:04:43.263000 22650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.262829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:43795 (local address 127.0.0.1:52362)
0810 21:04:43.262908 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:43.262956 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:43795: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260810 21:04:43.263185 21948 catalog_manager.cc:4584] TS 45da69923df34aeabc8d81da186fc4d0 (127.15.37.1:43795): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 33f0528954c041a794daaee0c7514248: Network error: Client connection negotiation failed: client connection to 127.15.37.1:43795: connect: Connection refused (error 111)
I20260810 21:04:43.274832 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 22450
I20260810 21:04:43.293356 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 21928
2026-08-10T21:04:43Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4058 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-10T21:04:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:43Z Disabled control of system clock
I20260810 21:04:43.333803 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:45747
--webserver_interface=127.15.37.62
--webserver_port=0
--builtin_ntp_servers=127.15.37.20:37257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:45747
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 21:04:43.422621 22701 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:43.422857 22701 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:43.422880 22701 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:43.423995 22701 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:43.424031 22701 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:43.424043 22701 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:43.424057 22701 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:43.424068 22701 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:43.425444 22701 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:45747
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:45747
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22701
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:43.425678 22701 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:43.425946 22701 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:43.431249 22708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:43.431298 22710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:43.431497 22701 server_base.cc:1034] running on GCE node
W20260810 21:04:43.431270 22712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:43.431936 22701 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:43.432291 22701 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:43.433434 22701 hybrid_clock.cc:648] HybridClock initialized: now 1786395883433420 us; error 32 us; skew 500 ppm
I20260810 21:04:43.434800 22701 webserver.cc:460] Webserver started at http://127.15.37.62:46097/ using document root <none> and password file <none>
I20260810 21:04:43.435072 22701 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:43.435149 22701 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:43.435307 22701 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:43.436450 22701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "00211db980e744e8bc3f0abb94df4baf"
format_stamp: "Formatted at 2026-08-10 21:04:43 on dist-test-slave-jq4t"
server_key: "f8281b6c14fdfe54c6c68acb6251297f"
server_key_iv: "0038ff945086913da8180e6d3bbd6f0a"
server_key_version: "encryptionkey@0"
I20260810 21:04:43.436911 22701 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "00211db980e744e8bc3f0abb94df4baf"
format_stamp: "Formatted at 2026-08-10 21:04:43 on dist-test-slave-jq4t"
server_key: "f8281b6c14fdfe54c6c68acb6251297f"
server_key_iv: "0038ff945086913da8180e6d3bbd6f0a"
server_key_version: "encryptionkey@0"
I20260810 21:04:43.438362 22701 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:04:43.439240 22720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:43.439419 22701 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:43.439536 22701 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "00211db980e744e8bc3f0abb94df4baf"
format_stamp: "Formatted at 2026-08-10 21:04:43 on dist-test-slave-jq4t"
server_key: "f8281b6c14fdfe54c6c68acb6251297f"
server_key_iv: "0038ff945086913da8180e6d3bbd6f0a"
server_key_version: "encryptionkey@0"
I20260810 21:04:43.439621 22701 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:43.443286 22701 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:43.443598 22701 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:43.443760 22701 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:43.448154 22701 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:45747
I20260810 21:04:43.448191 22795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:45747 every 8 connection(s)
I20260810 21:04:43.448635 22701 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:43.449337 22796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:43.452611 22796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf: Bootstrap starting.
I20260810 21:04:43.453295 22796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:43.453631 22796 log.cc:824] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:43.454460 22796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf: No bootstrap required, opened a new log
I20260810 21:04:43.456110 22796 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00211db980e744e8bc3f0abb94df4baf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 45747 } }
I20260810 21:04:43.456290 22796 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:43.456341 22796 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00211db980e744e8bc3f0abb94df4baf, State: Initialized, Role: FOLLOWER
I20260810 21:04:43.456559 22796 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00211db980e744e8bc3f0abb94df4baf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 45747 } }
I20260810 21:04:43.456671 22796 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:43.456718 22796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:43.456771 22796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:43.457386 22796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00211db980e744e8bc3f0abb94df4baf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 45747 } }
I20260810 21:04:43.457525 22796 leader_election.cc:302] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00211db980e744e8bc3f0abb94df4baf; no voters:
I20260810 21:04:43.457724 22796 leader_election.cc:288] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:43.457775 22799 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:43.457986 22799 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [term 1 LEADER]: Becoming Leader. State: Replica: 00211db980e744e8bc3f0abb94df4baf, State: Running, Role: LEADER
I20260810 21:04:43.458015 22796 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:43.458088 22799 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00211db980e744e8bc3f0abb94df4baf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 45747 } }
I20260810 21:04:43.458556 22801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00211db980e744e8bc3f0abb94df4baf. Latest consensus state: current_term: 1 leader_uuid: "00211db980e744e8bc3f0abb94df4baf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00211db980e744e8bc3f0abb94df4baf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 45747 } } }
I20260810 21:04:43.458647 22801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:43.458854 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 22701
I20260810 21:04:43.458963 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:43.459156 15508 external_mini_cluster.cc:1428] Setting key d20231463ed7d47eececa0e1487b0355
I20260810 21:04:43.459569 22800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00211db980e744e8bc3f0abb94df4baf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00211db980e744e8bc3f0abb94df4baf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 45747 } } }
I20260810 21:04:43.459661 22800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:43.460024 22815 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:43.460613 22815 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:43.461897 22814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.459751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44268 (local address 127.15.37.62:45747)
0810 21:04:43.460117 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:43.460127 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:43.460165 (+ 38us) server_negotiation.cc:407] Connection header received
0810 21:04:43.460311 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:43.460320 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:43.460375 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:43.460556 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:43.461375 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:43.461379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:43.461380 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:43.461385 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:43.461434 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:43.461456 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:43.461547 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:43.461626 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 21:04:43.461690 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":85,"threads_started":1}
I20260810 21:04:43.462580 22815 catalog_manager.cc:1347] Generated new cluster ID: 1f4b33577de84a49b1f5308574b5ee7b
I20260810 21:04:43.462632 22815 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:04:43.468662 22815 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:43.468854 22815 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:43.473572 22815 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf: Generated new TSK 0
I20260810 21:04:43.473816 22815 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:04:43.480849 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:45747
--builtin_ntp_servers=127.15.37.20:37257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 21:04:43.572019 22829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:43.572253 22829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:43.572279 22829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:43.573578 22829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:43.573634 22829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:43.573668 22829 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:04:43.575089 22829 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:45747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:43.575354 22829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:43.575693 22829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:43.581061 22837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:43.581080 22836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:43.581245 22840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:43.581434 22829 server_base.cc:1034] running on GCE node
I20260810 21:04:43.581682 22829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:43.581965 22829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:43.583132 22829 hybrid_clock.cc:648] HybridClock initialized: now 1786395883583119 us; error 33 us; skew 500 ppm
I20260810 21:04:43.584762 22829 webserver.cc:460] Webserver started at http://127.15.37.1:40541/ using document root <none> and password file <none>
I20260810 21:04:43.585048 22829 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:43.585096 22829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:43.585239 22829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:43.586437 22829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "a78fdda33320478ca8e4ff70219520cc"
format_stamp: "Formatted at 2026-08-10 21:04:43 on dist-test-slave-jq4t"
server_key: "01a7a5b44c5afaab8321f47c3f47c607"
server_key_iv: "e8ae44cecef45ad4be7cdceb83d8db17"
server_key_version: "encryptionkey@0"
I20260810 21:04:43.586848 22829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "a78fdda33320478ca8e4ff70219520cc"
format_stamp: "Formatted at 2026-08-10 21:04:43 on dist-test-slave-jq4t"
server_key: "01a7a5b44c5afaab8321f47c3f47c607"
server_key_iv: "e8ae44cecef45ad4be7cdceb83d8db17"
server_key_version: "encryptionkey@0"
I20260810 21:04:43.588312 22829 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:04:43.589195 22849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:43.589357 22829 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:43.589450 22829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "a78fdda33320478ca8e4ff70219520cc"
format_stamp: "Formatted at 2026-08-10 21:04:43 on dist-test-slave-jq4t"
server_key: "01a7a5b44c5afaab8321f47c3f47c607"
server_key_iv: "e8ae44cecef45ad4be7cdceb83d8db17"
server_key_version: "encryptionkey@0"
I20260810 21:04:43.589529 22829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:43.593235 22829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:43.593545 22829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:43.593689 22829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:43.593954 22829 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:43.594308 22829 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:43.594342 22829 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:43.594363 22829 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:43.594396 22829 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:43.600664 22829 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:37495
I20260810 21:04:43.600756 23012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:37495 every 8 connection(s)
I20260810 21:04:43.601110 22829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:04:43.604518 22814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.601925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:60233 (local address 127.15.37.62:45747)
0810 21:04:43.602002 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:43.602004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:43.602254 (+ 250us) server_negotiation.cc:407] Connection header received
0810 21:04:43.602808 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:43.602809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:43.602820 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:43.602869 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:43.604177 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:43.604179 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:43.604179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:43.604183 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:43.604200 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:43.604205 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:43.604258 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:43.604372 (+ 114us) server_negotiation.cc:299] Negotiation successful
0810 21:04:43.604398 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 21:04:43.604687 23016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.601897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:45747 (local address 127.15.37.1:60233)
0810 21:04:43.602128 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:43.602163 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:43.602682 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:43.602953 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:43.602957 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:43.602965 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:43.604005 (+ 1040us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:04:43.604005 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:43.604037 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:04:43.604067 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:43.604272 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:43.604277 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:43.604282 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:04:43.604369 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 21:04:43.604438 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":100,"threads_started":1}
I20260810 21:04:43.605242 23014 heartbeater.cc:347] Connected to a master server at 127.15.37.62:45747
I20260810 21:04:43.605348 23014 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:43.605520 23014 heartbeater.cc:511] Master 127.15.37.62:45747 requested a full tablet report, sending...
I20260810 21:04:43.606072 22744 ts_manager.cc:194] Registered new tserver with Master: a78fdda33320478ca8e4ff70219520cc (127.15.37.1:37495)
I20260810 21:04:43.607105 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 22829
I20260810 21:04:43.607218 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:04:43.607402 15508 external_mini_cluster.cc:1428] Setting key 2b8d8f9e6670d081a90bde56156dec2d
I20260810 21:04:43.608417 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:45747
--builtin_ntp_servers=127.15.37.20:37257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 21:04:43.697331 23018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:43.697606 23018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:43.697649 23018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:43.698920 23018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:43.699003 23018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:43.699054 23018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:04:43.700651 23018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:45747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:43.700968 23018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:43.701313 23018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:43.706895 23028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:43.706883 23026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:43.706884 23024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:43.707248 23018 server_base.cc:1034] running on GCE node
I20260810 21:04:43.707466 23018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:43.707682 23018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:43.708822 23018 hybrid_clock.cc:648] HybridClock initialized: now 1786395883708806 us; error 33 us; skew 500 ppm
I20260810 21:04:43.710179 23018 webserver.cc:460] Webserver started at http://127.15.37.2:37615/ using document root <none> and password file <none>
I20260810 21:04:43.710426 23018 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:43.710471 23018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:43.710570 23018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:43.711673 23018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "cdc39fe7cf20415f81655f23d49b66f4"
format_stamp: "Formatted at 2026-08-10 21:04:43 on dist-test-slave-jq4t"
server_key: "30e2519d4e4b21f4f54d0040e8a478ea"
server_key_iv: "50aae6e0f9dbd007d156498690818281"
server_key_version: "encryptionkey@0"
I20260810 21:04:43.711984 23018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "cdc39fe7cf20415f81655f23d49b66f4"
format_stamp: "Formatted at 2026-08-10 21:04:43 on dist-test-slave-jq4t"
server_key: "30e2519d4e4b21f4f54d0040e8a478ea"
server_key_iv: "50aae6e0f9dbd007d156498690818281"
server_key_version: "encryptionkey@0"
I20260810 21:04:43.713459 23018 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:04:43.714257 23037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:43.714511 23018 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:43.714633 23018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "cdc39fe7cf20415f81655f23d49b66f4"
format_stamp: "Formatted at 2026-08-10 21:04:43 on dist-test-slave-jq4t"
server_key: "30e2519d4e4b21f4f54d0040e8a478ea"
server_key_iv: "50aae6e0f9dbd007d156498690818281"
server_key_version: "encryptionkey@0"
I20260810 21:04:43.714718 23018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:43.718220 23018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:43.718516 23018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:43.718668 23018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:43.718888 23018 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:43.719223 23018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:43.719262 23018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:43.719282 23018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:43.719295 23018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:43.725176 23018 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:38403
I20260810 21:04:43.725267 23186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:38403 every 8 connection(s)
I20260810 21:04:43.725618 23018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:04:43.729236 22814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.726490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:55747 (local address 127.15.37.62:45747)
0810 21:04:43.726577 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:43.726580 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:43.726881 (+ 301us) server_negotiation.cc:407] Connection header received
0810 21:04:43.727422 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:43.727423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:43.727430 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:43.727495 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:43.728993 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:43.728994 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:43.728994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:43.728999 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:43.729017 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:43.729021 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:43.729075 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:43.729162 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 21:04:43.729175 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 21:04:43.729429 23196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.726476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:45747 (local address 127.15.37.2:55747)
0810 21:04:43.726744 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:43.726782 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:43.727283 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:43.727658 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:43.727662 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:43.727671 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:43.728800 (+ 1129us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:04:43.728800 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:43.728832 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:04:43.728865 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:43.729091 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:43.729094 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:43.729097 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:04:43.729154 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 21:04:43.729211 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":128,"threads_started":1}
I20260810 21:04:43.730021 23188 heartbeater.cc:347] Connected to a master server at 127.15.37.62:45747
I20260810 21:04:43.730118 23188 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:43.730242 23188 heartbeater.cc:511] Master 127.15.37.62:45747 requested a full tablet report, sending...
I20260810 21:04:43.730597 22744 ts_manager.cc:194] Registered new tserver with Master: cdc39fe7cf20415f81655f23d49b66f4 (127.15.37.2:38403)
I20260810 21:04:43.734472 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 23018
I20260810 21:04:43.734570 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:04:43.734763 15508 external_mini_cluster.cc:1428] Setting key 1ac87bb764610bdedf672a6ac28e52c0
I20260810 21:04:43.735803 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:45747
--builtin_ntp_servers=127.15.37.20:37257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 21:04:43.824216 23198 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:43.824463 23198 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:43.824510 23198 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:43.825794 23198 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:43.825855 23198 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:43.825883 23198 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:04:43.827350 23198 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:45747
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23198
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:43.827669 23198 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:43.828018 23198 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:43.833381 23208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:43.833398 23205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:43.833381 23206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:43.833665 23198 server_base.cc:1034] running on GCE node
I20260810 21:04:43.833917 23198 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:43.834179 23198 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:43.835352 23198 hybrid_clock.cc:648] HybridClock initialized: now 1786395883835339 us; error 53 us; skew 500 ppm
I20260810 21:04:43.836721 23198 webserver.cc:460] Webserver started at http://127.15.37.3:39675/ using document root <none> and password file <none>
I20260810 21:04:43.837011 23198 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:43.837086 23198 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:43.837248 23198 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:43.838407 23198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "6f4397a77af6444cacac2d990c91fea8"
format_stamp: "Formatted at 2026-08-10 21:04:43 on dist-test-slave-jq4t"
server_key: "c8ea323faddf7a58975daca97a0b3773"
server_key_iv: "06f6a9fd8ecff9317e947ed55558306f"
server_key_version: "encryptionkey@0"
I20260810 21:04:43.838804 23198 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "6f4397a77af6444cacac2d990c91fea8"
format_stamp: "Formatted at 2026-08-10 21:04:43 on dist-test-slave-jq4t"
server_key: "c8ea323faddf7a58975daca97a0b3773"
server_key_iv: "06f6a9fd8ecff9317e947ed55558306f"
server_key_version: "encryptionkey@0"
I20260810 21:04:43.840286 23198 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:43.841295 23219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:43.841526 23198 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:43.841645 23198 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "6f4397a77af6444cacac2d990c91fea8"
format_stamp: "Formatted at 2026-08-10 21:04:43 on dist-test-slave-jq4t"
server_key: "c8ea323faddf7a58975daca97a0b3773"
server_key_iv: "06f6a9fd8ecff9317e947ed55558306f"
server_key_version: "encryptionkey@0"
I20260810 21:04:43.841727 23198 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:43.845542 23198 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:43.845795 23198 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:43.845902 23198 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:43.846067 23198 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:43.846335 23198 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:43.846376 23198 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:43.846400 23198 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:43.846412 23198 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:43.852705 23198 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:39873
I20260810 21:04:43.852785 23375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:39873 every 8 connection(s)
I20260810 21:04:43.853192 23198 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:04:43.856725 22814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.854193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:46965 (local address 127.15.37.62:45747)
0810 21:04:43.854301 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:43.854303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:43.854551 (+ 248us) server_negotiation.cc:407] Connection header received
0810 21:04:43.855043 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:43.855044 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:43.855051 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:43.855120 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:43.856508 (+ 1388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:43.856510 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:43.856510 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:43.856515 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:43.856532 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:43.856537 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:43.856593 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:43.856649 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 21:04:43.856663 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 21:04:43.857067 23379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.854156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:45747 (local address 127.15.37.3:46965)
0810 21:04:43.854380 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:43.854424 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:43.854918 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:43.855205 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:43.855209 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:43.855218 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:43.856308 (+ 1090us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:04:43.856309 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:43.856341 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:04:43.856373 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:43.856593 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:43.856596 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:43.856599 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:04:43.856660 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 21:04:43.856718 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":116,"threads_started":1}
I20260810 21:04:43.857657 23377 heartbeater.cc:347] Connected to a master server at 127.15.37.62:45747
I20260810 21:04:43.857762 23377 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:43.857896 23377 heartbeater.cc:511] Master 127.15.37.62:45747 requested a full tablet report, sending...
I20260810 21:04:43.858335 22744 ts_manager.cc:194] Registered new tserver with Master: 6f4397a77af6444cacac2d990c91fea8 (127.15.37.3:39873)
I20260810 21:04:43.862308 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 23198
I20260810 21:04:43.862412 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:04:43.862602 15508 external_mini_cluster.cc:1428] Setting key e2c0181587f55072bd77868350211d59
I20260810 21:04:43.863574 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:04:43.866057 22814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.864989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44280 (local address 127.15.37.62:45747)
0810 21:04:43.865099 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:43.865101 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:43.865148 (+ 47us) server_negotiation.cc:407] Connection header received
0810 21:04:43.865194 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:43.865195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:43.865200 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:43.865251 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:43.865818 (+ 567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:43.865819 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:43.865819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:43.865823 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:43.865839 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:43.865843 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:43.865893 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:43.865944 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 21:04:43.865957 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260810 21:04:43.867692 22744 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44280:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:43.869449 22744 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:43.873696 23392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.872109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:39873 (local address 127.0.0.1:50794)
0810 21:04:43.872274 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:43.872283 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:43.872320 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:43.872681 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:43.872682 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:43.872685 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:43.873261 (+ 576us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:04:43.873261 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:43.873266 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:04:43.873277 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:43.873517 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:43.873518 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:43.873519 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 21:04:43.873561 (+ 42us) client_negotiation.cc:240] Negotiation successful
0810 21:04:43.873598 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":76,"threads_started":1}
I20260810 21:04:43.873724 23391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.871999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60686 (local address 127.15.37.1:37495)
0810 21:04:43.872342 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:43.872348 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:43.872361 (+ 13us) server_negotiation.cc:407] Connection header received
0810 21:04:43.872390 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:43.872393 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:43.872403 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:43.872811 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:43.873341 (+ 530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:43.873346 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:43.873346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:43.873350 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:43.873384 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:43.873403 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:43.873502 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:43.873623 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 21:04:43.873641 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":106,"threads_started":1}
I20260810 21:04:43.873703 23390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.871868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:37495 (local address 127.0.0.1:60686)
0810 21:04:43.872055 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:43.872104 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:43.872168 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:43.872557 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:43.872564 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:43.872571 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:43.873121 (+ 550us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:04:43.873122 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:43.873139 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:04:43.873163 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:43.873502 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:43.873509 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:43.873513 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:43.873590 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 21:04:43.873604 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":107,"threads_started":1}
I20260810 21:04:43.874025 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.872083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48856 (local address 127.15.37.2:38403)
0810 21:04:43.872462 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:43.872467 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:43.872507 (+ 40us) server_negotiation.cc:407] Connection header received
0810 21:04:43.872536 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:43.872538 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:43.872548 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:43.872625 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:43.873572 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:43.873581 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:43.873581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:43.873586 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:43.873626 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:43.873654 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:43.873709 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:43.873908 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 21:04:43.873941 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":95,"threads_started":1}
I20260810 21:04:43.874243 23395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.872287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50794 (local address 127.15.37.3:39873)
0810 21:04:43.872527 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:43.872531 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:43.872540 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:04:43.872565 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:43.872567 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:43.872576 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:43.872824 (+ 248us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:43.873362 (+ 538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:43.873369 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:43.873370 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:43.873375 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:43.873406 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:43.873427 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:43.874112 (+ 685us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:43.874140 (+ 28us) server_negotiation.cc:299] Negotiation successful
0810 21:04:43.874157 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":101,"threads_started":1}
I20260810 21:04:43.873847 23388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:43.871868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:38403 (local address 127.0.0.1:48856)
0810 21:04:43.872241 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:43.872252 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:43.872302 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:43.872975 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:43.872976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:43.872980 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:43.873453 (+ 473us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:04:43.873454 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:43.873462 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:04:43.873475 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:43.873734 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:43.873735 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:43.873736 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 21:04:43.873782 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 21:04:43.873795 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":2,"thread_start_us":88,"threads_started":1}
I20260810 21:04:43.874789 22920 tablet_service.cc:1467] Processing CreateTablet for tablet 7b503260d1c8400cb51a1cd1c204844b (DEFAULT_TABLE table=test-table [id=14b05526be3e40e491bcc8daa52c7564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:43.874883 23285 tablet_service.cc:1467] Processing CreateTablet for tablet 7b503260d1c8400cb51a1cd1c204844b (DEFAULT_TABLE table=test-table [id=14b05526be3e40e491bcc8daa52c7564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:43.875234 23285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b503260d1c8400cb51a1cd1c204844b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:43.875237 22920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b503260d1c8400cb51a1cd1c204844b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:43.875123 23101 tablet_service.cc:1467] Processing CreateTablet for tablet 7b503260d1c8400cb51a1cd1c204844b (DEFAULT_TABLE table=test-table [id=14b05526be3e40e491bcc8daa52c7564]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:43.875463 23101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b503260d1c8400cb51a1cd1c204844b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:43.877949 23396 tablet_bootstrap.cc:492] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8: Bootstrap starting.
I20260810 21:04:43.878649 23398 tablet_bootstrap.cc:492] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4: Bootstrap starting.
I20260810 21:04:43.878706 23396 tablet_bootstrap.cc:654] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:43.879051 23396 log.cc:824] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:43.879413 23398 tablet_bootstrap.cc:654] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:43.879758 23398 log.cc:824] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:43.879943 23396 tablet_bootstrap.cc:492] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8: No bootstrap required, opened a new log
I20260810 21:04:43.880030 23396 ts_tablet_manager.cc:1397] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:04:43.880126 23397 tablet_bootstrap.cc:492] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc: Bootstrap starting.
I20260810 21:04:43.880574 23398 tablet_bootstrap.cc:492] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4: No bootstrap required, opened a new log
I20260810 21:04:43.880661 23398 ts_tablet_manager.cc:1397] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:04:43.880820 23397 tablet_bootstrap.cc:654] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:43.881211 23397 log.cc:824] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:43.882091 23397 tablet_bootstrap.cc:492] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc: No bootstrap required, opened a new log
I20260810 21:04:43.882220 23397 ts_tablet_manager.cc:1397] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:04:43.882930 23398 raft_consensus.cc:348] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdc39fe7cf20415f81655f23d49b66f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38403 } } peers { permanent_uuid: "6f4397a77af6444cacac2d990c91fea8" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39873 } } peers { permanent_uuid: "a78fdda33320478ca8e4ff70219520cc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37495 } }
I20260810 21:04:43.882899 23396 raft_consensus.cc:348] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdc39fe7cf20415f81655f23d49b66f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38403 } } peers { permanent_uuid: "6f4397a77af6444cacac2d990c91fea8" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39873 } } peers { permanent_uuid: "a78fdda33320478ca8e4ff70219520cc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37495 } }
I20260810 21:04:43.883085 23396 raft_consensus.cc:374] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:43.883086 23398 raft_consensus.cc:374] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:43.883138 23398 raft_consensus.cc:729] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdc39fe7cf20415f81655f23d49b66f4, State: Initialized, Role: FOLLOWER
I20260810 21:04:43.883169 23396 raft_consensus.cc:729] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f4397a77af6444cacac2d990c91fea8, State: Initialized, Role: FOLLOWER
I20260810 21:04:43.883304 23396 consensus_queue.cc:260] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdc39fe7cf20415f81655f23d49b66f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38403 } } peers { permanent_uuid: "6f4397a77af6444cacac2d990c91fea8" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39873 } } peers { permanent_uuid: "a78fdda33320478ca8e4ff70219520cc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37495 } }
I20260810 21:04:43.883306 23398 consensus_queue.cc:260] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdc39fe7cf20415f81655f23d49b66f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38403 } } peers { permanent_uuid: "6f4397a77af6444cacac2d990c91fea8" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39873 } } peers { permanent_uuid: "a78fdda33320478ca8e4ff70219520cc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37495 } }
I20260810 21:04:43.883572 23396 ts_tablet_manager.cc:1428] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260810 21:04:43.883673 23398 ts_tablet_manager.cc:1428] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:04:43.883749 23377 heartbeater.cc:503] Master 127.15.37.62:45747 was elected leader, sending a full tablet report...
I20260810 21:04:43.883841 23188 heartbeater.cc:503] Master 127.15.37.62:45747 was elected leader, sending a full tablet report...
I20260810 21:04:43.885021 23397 raft_consensus.cc:348] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdc39fe7cf20415f81655f23d49b66f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38403 } } peers { permanent_uuid: "6f4397a77af6444cacac2d990c91fea8" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39873 } } peers { permanent_uuid: "a78fdda33320478ca8e4ff70219520cc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37495 } }
I20260810 21:04:43.885195 23397 raft_consensus.cc:374] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:43.885242 23397 raft_consensus.cc:729] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a78fdda33320478ca8e4ff70219520cc, State: Initialized, Role: FOLLOWER
I20260810 21:04:43.885358 23397 consensus_queue.cc:260] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdc39fe7cf20415f81655f23d49b66f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38403 } } peers { permanent_uuid: "6f4397a77af6444cacac2d990c91fea8" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39873 } } peers { permanent_uuid: "a78fdda33320478ca8e4ff70219520cc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37495 } }
I20260810 21:04:43.885619 23397 ts_tablet_manager.cc:1428] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260810 21:04:43.885677 23014 heartbeater.cc:503] Master 127.15.37.62:45747 was elected leader, sending a full tablet report...
W20260810 21:04:43.976308 23193 tablet.cc:2369] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:04:44.101924 23015 tablet.cc:2369] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:04:44.103811 23378 tablet.cc:2369] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:04:44.244560 23407 raft_consensus.cc:482] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:44.244712 23407 raft_consensus.cc:504] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdc39fe7cf20415f81655f23d49b66f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38403 } } peers { permanent_uuid: "6f4397a77af6444cacac2d990c91fea8" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39873 } } peers { permanent_uuid: "a78fdda33320478ca8e4ff70219520cc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37495 } }
I20260810 21:04:44.245213 23407 leader_election.cc:288] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f4397a77af6444cacac2d990c91fea8 (127.15.37.3:39873), a78fdda33320478ca8e4ff70219520cc (127.15.37.1:37495)
I20260810 21:04:44.246912 23391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:44.245534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:52807 (local address 127.15.37.1:37495)
0810 21:04:44.245601 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:44.245604 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:44.245739 (+ 135us) server_negotiation.cc:407] Connection header received
0810 21:04:44.245776 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:44.245777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:44.245784 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:44.245845 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:44.246656 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:44.246657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:44.246658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:44.246663 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:44.246679 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:44.246684 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:44.246748 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:44.246824 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 21:04:44.246837 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 21:04:44.246912 23395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:44.245553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:56945 (local address 127.15.37.3:39873)
0810 21:04:44.245605 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:44.245607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:44.245738 (+ 131us) server_negotiation.cc:407] Connection header received
0810 21:04:44.245776 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:44.245777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:44.245783 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:44.245845 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:44.246656 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:44.246657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:44.246658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:44.246663 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:44.246679 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:44.246684 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:44.246748 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:44.246819 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 21:04:44.246835 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 21:04:44.246944 23409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:44.245447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:37495 (local address 127.15.37.2:52807)
0810 21:04:44.245595 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:44.245607 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:44.245680 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:44.245901 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:44.245902 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:44.245925 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:44.246554 (+ 629us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:04:44.246555 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:44.246559 (+ 4us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:04:44.246569 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:44.246758 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:44.246759 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:44.246760 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 21:04:44.246813 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 21:04:44.246832 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":3,"thread_start_us":76,"threads_started":1}
I20260810 21:04:44.246954 23411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:44.245447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:39873 (local address 127.15.37.2:56945)
0810 21:04:44.245629 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:44.245638 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:44.245684 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:44.245900 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:44.245902 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:44.245906 (+ 4us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:44.246520 (+ 614us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:04:44.246521 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:44.246531 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:04:44.246548 (+ 17us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:44.246758 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:44.246759 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:44.246760 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 21:04:44.246809 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 21:04:44.246829 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":3,"thread_start_us":72,"threads_started":1}
I20260810 21:04:44.247359 22949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b503260d1c8400cb51a1cd1c204844b" candidate_uuid: "cdc39fe7cf20415f81655f23d49b66f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a78fdda33320478ca8e4ff70219520cc" is_pre_election: true
I20260810 21:04:44.247418 23312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b503260d1c8400cb51a1cd1c204844b" candidate_uuid: "cdc39fe7cf20415f81655f23d49b66f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f4397a77af6444cacac2d990c91fea8" is_pre_election: true
I20260810 21:04:44.247556 22949 raft_consensus.cc:2454] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdc39fe7cf20415f81655f23d49b66f4 in term 0.
I20260810 21:04:44.247575 23312 raft_consensus.cc:2454] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdc39fe7cf20415f81655f23d49b66f4 in term 0.
I20260810 21:04:44.247820 23041 leader_election.cc:302] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a78fdda33320478ca8e4ff70219520cc, cdc39fe7cf20415f81655f23d49b66f4; no voters:
I20260810 21:04:44.248010 23407 raft_consensus.cc:2781] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:44.248117 23407 raft_consensus.cc:482] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:44.248155 23407 raft_consensus.cc:3037] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:44.249049 23407 raft_consensus.cc:504] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdc39fe7cf20415f81655f23d49b66f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38403 } } peers { permanent_uuid: "6f4397a77af6444cacac2d990c91fea8" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39873 } } peers { permanent_uuid: "a78fdda33320478ca8e4ff70219520cc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37495 } }
I20260810 21:04:44.249228 23407 leader_election.cc:288] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [CANDIDATE]: Term 1 election: Requested vote from peers 6f4397a77af6444cacac2d990c91fea8 (127.15.37.3:39873), a78fdda33320478ca8e4ff70219520cc (127.15.37.1:37495)
I20260810 21:04:44.249455 22949 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b503260d1c8400cb51a1cd1c204844b" candidate_uuid: "cdc39fe7cf20415f81655f23d49b66f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a78fdda33320478ca8e4ff70219520cc"
I20260810 21:04:44.249495 23312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b503260d1c8400cb51a1cd1c204844b" candidate_uuid: "cdc39fe7cf20415f81655f23d49b66f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f4397a77af6444cacac2d990c91fea8"
I20260810 21:04:44.249570 23312 raft_consensus.cc:3037] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:44.249577 22949 raft_consensus.cc:3037] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:44.250334 23312 raft_consensus.cc:2454] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdc39fe7cf20415f81655f23d49b66f4 in term 1.
I20260810 21:04:44.250451 22949 raft_consensus.cc:2454] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdc39fe7cf20415f81655f23d49b66f4 in term 1.
I20260810 21:04:44.250542 23044 leader_election.cc:302] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f4397a77af6444cacac2d990c91fea8, cdc39fe7cf20415f81655f23d49b66f4; no voters:
I20260810 21:04:44.250638 23407 raft_consensus.cc:2781] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:44.250809 23407 raft_consensus.cc:686] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [term 1 LEADER]: Becoming Leader. State: Replica: cdc39fe7cf20415f81655f23d49b66f4, State: Running, Role: LEADER
I20260810 21:04:44.250949 23407 consensus_queue.cc:237] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdc39fe7cf20415f81655f23d49b66f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38403 } } peers { permanent_uuid: "6f4397a77af6444cacac2d990c91fea8" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39873 } } peers { permanent_uuid: "a78fdda33320478ca8e4ff70219520cc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37495 } }
I20260810 21:04:44.251859 22744 catalog_manager.cc:5495] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to cdc39fe7cf20415f81655f23d49b66f4 (127.15.37.2). New cstate: current_term: 1 leader_uuid: "cdc39fe7cf20415f81655f23d49b66f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdc39fe7cf20415f81655f23d49b66f4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f4397a77af6444cacac2d990c91fea8" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39873 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a78fdda33320478ca8e4ff70219520cc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37495 } health_report { overall_health: UNKNOWN } } }
I20260810 21:04:44.320751 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:44.319566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48872 (local address 127.15.37.2:38403)
0810 21:04:44.319638 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:44.319640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:44.319649 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:04:44.319736 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:44.319737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:44.319752 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:44.319796 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:44.320424 (+ 628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:44.320425 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:44.320425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:44.320429 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:44.320445 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:44.320449 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:44.320574 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:44.320624 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 21:04:44.320637 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 21:04:44.322836 23312 raft_consensus.cc:1261] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8 [term 1 FOLLOWER]: Refusing update from remote peer cdc39fe7cf20415f81655f23d49b66f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:44.322924 22949 raft_consensus.cc:1261] T 7b503260d1c8400cb51a1cd1c204844b P a78fdda33320478ca8e4ff70219520cc [term 1 FOLLOWER]: Refusing update from remote peer cdc39fe7cf20415f81655f23d49b66f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:44.323307 23407 consensus_queue.cc:1035] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a78fdda33320478ca8e4ff70219520cc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:44.323498 23413 consensus_queue.cc:1035] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f4397a77af6444cacac2d990c91fea8" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39873 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:44.327829 23419 mvcc.cc:205] Tried to move back new op lower bound from 7317077542183313408 to 7317077541892427776. Current Snapshot: MvccSnapshot[applied={T|T < 7317077542183313408}]
I20260810 21:04:44.328541 23421 mvcc.cc:205] Tried to move back new op lower bound from 7317077542183313408 to 7317077541892427776. Current Snapshot: MvccSnapshot[applied={T|T < 7317077542183313408}]
I20260810 21:04:44.328714 23417 mvcc.cc:205] Tried to move back new op lower bound from 7317077542183313408 to 7317077541892427776. Current Snapshot: MvccSnapshot[applied={T|T < 7317077542183313408 or (T in {7317077542183313408})}]
I20260810 21:04:44.330053 22744 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:44.330168 22744 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:44.331205 22744 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 00211db980e744e8bc3f0abb94df4baf: Sending DeleteTablet for 3 replicas of tablet 7b503260d1c8400cb51a1cd1c204844b
I20260810 21:04:44.331571 23285 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b503260d1c8400cb51a1cd1c204844b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:44 UTC) from {username='slave'} at 127.0.0.1:50794
I20260810 21:04:44.331588 22920 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b503260d1c8400cb51a1cd1c204844b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:44 UTC) from {username='slave'} at 127.0.0.1:60686
I20260810 21:04:44.331887 23101 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b503260d1c8400cb51a1cd1c204844b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:44 UTC) from {username='slave'} at 127.0.0.1:48856
I20260810 21:04:44.332127 23433 tablet_replica.cc:330] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4: stopping tablet replica
I20260810 21:04:44.332131 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 22829
I20260810 21:04:44.345677 23433 raft_consensus.cc:2229] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:04:44.345917 23433 raft_consensus.cc:2258] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:44.347817 23433 ts_tablet_manager.cc:1905] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:44.350431 23433 ts_tablet_manager.cc:1918] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:44.350549 23433 log.cc:1196] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/7b503260d1c8400cb51a1cd1c204844b
I20260810 21:04:44.350931 23433 ts_tablet_manager.cc:1939] T 7b503260d1c8400cb51a1cd1c204844b P cdc39fe7cf20415f81655f23d49b66f4: Deleting consensus metadata
I20260810 21:04:44.353190 22728 catalog_manager.cc:4841] TS cdc39fe7cf20415f81655f23d49b66f4 (127.15.37.2:38403): tablet 7b503260d1c8400cb51a1cd1c204844b (table test-table [id=14b05526be3e40e491bcc8daa52c7564]) successfully deleted
I20260810 21:04:44.355880 23431 tablet_replica.cc:330] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8: stopping tablet replica
I20260810 21:04:44.355983 23431 raft_consensus.cc:2229] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:44.356086 23431 raft_consensus.cc:2258] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:44.356745 23431 ts_tablet_manager.cc:1905] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:44.358891 23431 ts_tablet_manager.cc:1918] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:44.358983 23431 log.cc:1196] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/7b503260d1c8400cb51a1cd1c204844b
I20260810 21:04:44.359268 23431 ts_tablet_manager.cc:1939] T 7b503260d1c8400cb51a1cd1c204844b P 6f4397a77af6444cacac2d990c91fea8: Deleting consensus metadata
I20260810 21:04:44.359827 22728 catalog_manager.cc:4841] TS 6f4397a77af6444cacac2d990c91fea8 (127.15.37.3:39873): tablet 7b503260d1c8400cb51a1cd1c204844b (table test-table [id=14b05526be3e40e491bcc8daa52c7564]) successfully deleted
W20260810 21:04:44.362818 22724 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:37495 (error 108)
I20260810 21:04:44.363446 23388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:44.363277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:37495 (local address 127.0.0.1:60688)
0810 21:04:44.363346 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:44.363407 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:37495: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 21:04:44.363534 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 23018
W20260810 21:04:44.373152 22724 catalog_manager.cc:4584] TS a78fdda33320478ca8e4ff70219520cc (127.15.37.1:37495): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7b503260d1c8400cb51a1cd1c204844b: Network error: Client connection negotiation failed: client connection to 127.15.37.1:37495: connect: Connection refused (error 111)
I20260810 21:04:44.380334 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 23198
I20260810 21:04:44.400182 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 22701
2026-08-10T21:04:44Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1106 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260810 21:04:44.431078 15508 mini_oidc.cc:152] Starting JWKS server
I20260810 21:04:44.432363 15508 webserver.cc:460] Webserver started at https://127.0.0.1:42947/ using document root <none> and password file <none>
I20260810 21:04:44.432535 15508 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 21:04:44.432741 15508 webserver.cc:460] Webserver started at http://127.0.0.1:41387/ using document root <none> and password file <none>
2026-08-10T21:04:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:44Z Disabled control of system clock
I20260810 21:04:44.442093 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:43909
--webserver_interface=127.15.37.62
--webserver_port=0
--builtin_ntp_servers=127.15.37.20:44039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:43909
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42947/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/testchainca.cert with env {}
W20260810 21:04:44.529474 23444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:44.529723 23444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:44.529750 23444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:44.531006 23444 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:44.531050 23444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:44.531064 23444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:44.531076 23444 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:44.531088 23444 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 21:04:44.531101 23444 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 21:04:44.531112 23444 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42947/jwks.json
I20260810 21:04:44.532826 23444 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:43909
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:43909
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42947/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23444
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:44.533078 23444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:44.533258 23444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 21:04:44.538883 23444 server_base.cc:1034] running on GCE node
W20260810 21:04:44.538861 23452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:44.538861 23450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:44.538861 23449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:44.539419 23444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:44.539781 23444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:44.540967 23444 hybrid_clock.cc:648] HybridClock initialized: now 1786395884540950 us; error 49 us; skew 500 ppm
I20260810 21:04:44.542357 23444 webserver.cc:460] Webserver started at http://127.15.37.62:38983/ using document root <none> and password file <none>
I20260810 21:04:44.542631 23444 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:44.542707 23444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:44.542865 23444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:44.544061 23444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "2f018d9333e141899fbeadc690260ad9"
format_stamp: "Formatted at 2026-08-10 21:04:44 on dist-test-slave-jq4t"
server_key: "a00a0f735dc4d7a771e6cf5697a90bf5"
server_key_iv: "b48deae6e918662e6fea84b9670bceaa"
server_key_version: "encryptionkey@0"
I20260810 21:04:44.544464 23444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "2f018d9333e141899fbeadc690260ad9"
format_stamp: "Formatted at 2026-08-10 21:04:44 on dist-test-slave-jq4t"
server_key: "a00a0f735dc4d7a771e6cf5697a90bf5"
server_key_iv: "b48deae6e918662e6fea84b9670bceaa"
server_key_version: "encryptionkey@0"
I20260810 21:04:44.545946 23444 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:44.546801 23461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:44.546991 23444 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:44.547113 23444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "2f018d9333e141899fbeadc690260ad9"
format_stamp: "Formatted at 2026-08-10 21:04:44 on dist-test-slave-jq4t"
server_key: "a00a0f735dc4d7a771e6cf5697a90bf5"
server_key_iv: "b48deae6e918662e6fea84b9670bceaa"
server_key_version: "encryptionkey@0"
I20260810 21:04:44.547202 23444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:44.562283 23444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:44.562678 23444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:44.562852 23444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:44.567206 23444 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:43909
I20260810 21:04:44.567260 23535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:43909 every 8 connection(s)
I20260810 21:04:44.567663 23444 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:44.568917 23537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:44.571534 23537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9: Bootstrap starting.
I20260810 21:04:44.572224 23537 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:44.572618 23537 log.cc:824] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:44.573523 23537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9: No bootstrap required, opened a new log
I20260810 21:04:44.575251 23537 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f018d9333e141899fbeadc690260ad9" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43909 } }
I20260810 21:04:44.575423 23537 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:44.575449 23537 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f018d9333e141899fbeadc690260ad9, State: Initialized, Role: FOLLOWER
I20260810 21:04:44.575651 23537 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f018d9333e141899fbeadc690260ad9" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43909 } }
I20260810 21:04:44.575726 23537 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:44.575771 23537 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:44.575826 23537 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:44.576538 23537 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f018d9333e141899fbeadc690260ad9" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43909 } }
I20260810 21:04:44.576673 23537 leader_election.cc:302] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f018d9333e141899fbeadc690260ad9; no voters:
I20260810 21:04:44.576871 23537 leader_election.cc:288] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:44.576964 23542 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:44.577163 23542 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [term 1 LEADER]: Becoming Leader. State: Replica: 2f018d9333e141899fbeadc690260ad9, State: Running, Role: LEADER
I20260810 21:04:44.577234 23537 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:44.577317 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 23444
I20260810 21:04:44.577353 23542 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f018d9333e141899fbeadc690260ad9" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43909 } }
I20260810 21:04:44.577430 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:44.577621 15508 external_mini_cluster.cc:1428] Setting key 8a20255977eefd8d5bcce57cbd8321df
I20260810 21:04:44.577791 23544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f018d9333e141899fbeadc690260ad9. Latest consensus state: current_term: 1 leader_uuid: "2f018d9333e141899fbeadc690260ad9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f018d9333e141899fbeadc690260ad9" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43909 } } }
I20260810 21:04:44.577888 23543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f018d9333e141899fbeadc690260ad9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f018d9333e141899fbeadc690260ad9" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43909 } } }
I20260810 21:04:44.577888 23544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:44.577965 23543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:44.578161 23552 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:44.579334 23552 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:44.581312 23552 catalog_manager.cc:1347] Generated new cluster ID: 9fafae0f8dd048d8b30f500df1ff6ebf
I20260810 21:04:44.581375 23552 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:04:44.584627 23557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:44.578323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50800 (local address 127.15.37.62:43909)
0810 21:04:44.578622 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:44.578632 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:44.578670 (+ 38us) server_negotiation.cc:407] Connection header received
0810 21:04:44.578880 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:44.578888 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:44.578967 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:44.579154 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:44.579428 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:44.581051 (+ 1623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:44.582220 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:44.582870 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:44.582992 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:44.583832 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:44.583836 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:44.583837 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:44.584060 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:44.584102 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:44.584117 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:44.584186 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:44.584278 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 21:04:44.584362 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":89,"threads_started":1}
I20260810 21:04:44.585646 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:04:44.617741 23552 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:44.618363 23552 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:44.627417 23552 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f018d9333e141899fbeadc690260ad9: Generated new TSK 0
I20260810 21:04:44.627713 23552 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:04:44.652456 23557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:44.636742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50808 (local address 127.15.37.62:43909)
0810 21:04:44.636797 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:44.636800 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:44.637034 (+ 234us) server_negotiation.cc:407] Connection header received
0810 21:04:44.637207 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:44.637208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:44.637222 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:44.637287 (+ 65us) server_negotiation.cc:226] Negotiated authn=JWT
0810 21:04:44.637460 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:44.637972 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:44.639108 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:44.639299 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:44.639357 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:44.639619 (+ 262us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 21:04:44.652252 (+ 12633us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42947/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 21:04:44.652394 (+ 142us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50808: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42947/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":30}
E20260810 21:04:44.652829 23579 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
W20260810 21:04:44.652913 23557 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50808: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42947/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
E20260810 21:04:44.652983 23579 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260810 21:04:44.653390 23578 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:04:44.636624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:43909 (local address 127.0.0.1:50808)
0810 21:04:44.636865 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:44.636878 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:44.637078 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:44.637325 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:44.637326 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:44.637329 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0810 21:04:44.637395 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:44.637397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:44.638072 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:44.638074 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:44.638997 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:44.639000 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:44.639397 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:44.639398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:44.639461 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:44.639492 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 21:04:44.652454 (+ 12962us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42947/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 21:04:44.652660 (+ 206us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.37.62:43909: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42947/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":108,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.15.37.62:43909: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42947/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260810 21:04:44.653997 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 23444
2026-08-10T21:04:44Z chronyd exiting
I20260810 21:04:44.700325 15508 test_util.cc:175] -----------------------------------------------
I20260810 21:04:44.700428 15508 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786395855004795-15508-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (270 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260810 21:04:44.701282 15508 mini_oidc.cc:152] Starting JWKS server
I20260810 21:04:44.702019 15508 webserver.cc:460] Webserver started at https://127.0.0.1:38179/ using document root <none> and password file <none>
I20260810 21:04:44.702064 15508 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 21:04:44.702217 15508 webserver.cc:460] Webserver started at http://127.0.0.1:38949/ using document root <none> and password file <none>
2026-08-10T21:04:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:44Z Disabled control of system clock
I20260810 21:04:44.712065 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:35333
--webserver_interface=127.15.37.62
--webserver_port=0
--builtin_ntp_servers=127.15.37.20:34339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:35333
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38179/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/testchainca.cert with env {}
W20260810 21:04:44.799433 23586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:44.799706 23586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:44.799753 23586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:44.801048 23586 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:44.801132 23586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:44.801153 23586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:44.801177 23586 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:44.801208 23586 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 21:04:44.801229 23586 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 21:04:44.801257 23586 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38179/jwks.json
I20260810 21:04:44.802930 23586 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:35333
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:35333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38179/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:44.803263 23586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:44.803511 23586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:44.808862 23595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:44.808926 23586 server_base.cc:1034] running on GCE node
W20260810 21:04:44.808862 23593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:44.808933 23592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:44.809509 23586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:44.809913 23586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:44.811107 23586 hybrid_clock.cc:648] HybridClock initialized: now 1786395884811101 us; error 44 us; skew 500 ppm
I20260810 21:04:44.812726 23586 webserver.cc:460] Webserver started at http://127.15.37.62:41423/ using document root <none> and password file <none>
I20260810 21:04:44.813035 23586 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:44.813115 23586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:44.813279 23586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:44.814446 23586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "f45caa30b45747e7a090439db5530f39"
format_stamp: "Formatted at 2026-08-10 21:04:44 on dist-test-slave-jq4t"
server_key: "5328acd760d7917f14dab06835912fdc"
server_key_iv: "fc47b5a147708af4ba46fa1a2283d647"
server_key_version: "encryptionkey@0"
I20260810 21:04:44.814839 23586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "f45caa30b45747e7a090439db5530f39"
format_stamp: "Formatted at 2026-08-10 21:04:44 on dist-test-slave-jq4t"
server_key: "5328acd760d7917f14dab06835912fdc"
server_key_iv: "fc47b5a147708af4ba46fa1a2283d647"
server_key_version: "encryptionkey@0"
I20260810 21:04:44.816286 23586 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:44.817312 23604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:44.817546 23586 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:44.817663 23586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "f45caa30b45747e7a090439db5530f39"
format_stamp: "Formatted at 2026-08-10 21:04:44 on dist-test-slave-jq4t"
server_key: "5328acd760d7917f14dab06835912fdc"
server_key_iv: "fc47b5a147708af4ba46fa1a2283d647"
server_key_version: "encryptionkey@0"
I20260810 21:04:44.817755 23586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:44.824600 23586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:44.824960 23586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:44.825125 23586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:44.829490 23586 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:35333
I20260810 21:04:44.829526 23675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:35333 every 8 connection(s)
I20260810 21:04:44.829927 23586 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:44.830698 23676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:44.833844 23676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39: Bootstrap starting.
I20260810 21:04:44.834483 23676 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:44.834803 23676 log.cc:824] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:44.835543 23676 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39: No bootstrap required, opened a new log
I20260810 21:04:44.837299 23676 raft_consensus.cc:348] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45caa30b45747e7a090439db5530f39" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35333 } }
I20260810 21:04:44.837453 23676 raft_consensus.cc:374] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:44.837478 23676 raft_consensus.cc:729] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f45caa30b45747e7a090439db5530f39, State: Initialized, Role: FOLLOWER
I20260810 21:04:44.837589 23676 consensus_queue.cc:260] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45caa30b45747e7a090439db5530f39" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35333 } }
I20260810 21:04:44.837685 23676 raft_consensus.cc:388] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:44.837741 23676 raft_consensus.cc:482] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:44.837813 23676 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:44.838409 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 23586
I20260810 21:04:44.838434 23676 raft_consensus.cc:504] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45caa30b45747e7a090439db5530f39" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35333 } }
I20260810 21:04:44.838562 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:44.838562 23676 leader_election.cc:302] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f45caa30b45747e7a090439db5530f39; no voters:
I20260810 21:04:44.838765 23676 leader_election.cc:288] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:44.838794 15508 external_mini_cluster.cc:1428] Setting key 790286fd4afdbb553ef09a421fbb05f6
I20260810 21:04:44.838809 23679 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:44.838935 23679 raft_consensus.cc:686] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [term 1 LEADER]: Becoming Leader. State: Replica: f45caa30b45747e7a090439db5530f39, State: Running, Role: LEADER
I20260810 21:04:44.839074 23676 sys_catalog.cc:564] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:44.839107 23679 consensus_queue.cc:237] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45caa30b45747e7a090439db5530f39" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35333 } }
I20260810 21:04:44.839596 23680 sys_catalog.cc:455] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f45caa30b45747e7a090439db5530f39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45caa30b45747e7a090439db5530f39" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35333 } } }
I20260810 21:04:44.839679 23680 sys_catalog.cc:458] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:44.839844 23682 sys_catalog.cc:455] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f45caa30b45747e7a090439db5530f39. Latest consensus state: current_term: 1 leader_uuid: "f45caa30b45747e7a090439db5530f39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f45caa30b45747e7a090439db5530f39" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35333 } } }
I20260810 21:04:44.839958 23682 sys_catalog.cc:458] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:44.840070 23689 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:44.840747 23689 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:44.842651 23689 catalog_manager.cc:1347] Generated new cluster ID: aac981d05580442da42f4715c210f0e9
I20260810 21:04:44.842710 23689 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:04:44.846837 23688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:44.839513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44318 (local address 127.15.37.62:35333)
0810 21:04:44.840711 (+ 1198us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:44.840722 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:44.840758 (+ 36us) server_negotiation.cc:407] Connection header received
0810 21:04:44.840898 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:44.840907 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:44.840989 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:44.841271 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:44.841568 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:44.843075 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:44.844232 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:44.845056 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:44.845212 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:44.845998 (+ 786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:44.846002 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:44.846003 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:44.846252 (+ 249us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:44.846301 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:44.846318 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:44.846414 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:44.846486 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 21:04:44.846581 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1105,"thread_start_us":73,"threads_started":1}
I20260810 21:04:44.847908 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:04:44.858243 23689 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:44.858832 23689 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:44.865785 23689 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f45caa30b45747e7a090439db5530f39: Generated new TSK 0
I20260810 21:04:44.866045 23689 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 21:04:44.892659 23720 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260810 21:04:44.892771 23720 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 21:04:44.893155 23688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:44.878218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44320 (local address 127.15.37.62:35333)
0810 21:04:44.878286 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:44.878289 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:44.878346 (+ 57us) server_negotiation.cc:407] Connection header received
0810 21:04:44.878420 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:44.878421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:44.878435 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:44.878523 (+ 88us) server_negotiation.cc:226] Negotiated authn=JWT
0810 21:04:44.878651 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:44.879497 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:44.880323 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:44.880681 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:44.880753 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:44.880941 (+ 188us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 21:04:44.892891 (+ 11950us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38179/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 21:04:44.893077 (+ 186us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44320: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38179/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":40}
W20260810 21:04:44.893222 23688 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44320: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38179/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260810 21:04:44.893242 23716 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:04:44.878093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:35333 (local address 127.0.0.1:44320)
0810 21:04:44.878290 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:44.878299 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:44.878354 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:44.878531 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:44.878532 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:44.878533 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0810 21:04:44.878589 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:44.878592 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:44.879590 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:44.879591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:44.880228 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:44.880230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:44.880765 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:44.880766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:44.880815 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:44.880821 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 21:04:44.893034 (+ 12213us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38179/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 21:04:44.893140 (+ 106us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.37.62:35333: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38179/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":110,"threads_started":1}
I20260810 21:04:44.893538 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 23586
2026-08-10T21:04:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (238 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260810 21:04:44.939775 15508 mini_oidc.cc:152] Starting JWKS server
I20260810 21:04:44.940536 15508 webserver.cc:460] Webserver started at https://127.0.0.1:37015/ using document root <none> and password file <none>
I20260810 21:04:44.940598 15508 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 21:04:44.940752 15508 webserver.cc:460] Webserver started at http://127.0.0.1:36813/ using document root <none> and password file <none>
2026-08-10T21:04:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:44Z Disabled control of system clock
I20260810 21:04:44.950631 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:34877
--webserver_interface=127.15.37.62
--webserver_port=0
--builtin_ntp_servers=127.15.37.20:44193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:34877
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37015/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 21:04:45.039230 23727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:45.039546 23727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:45.039589 23727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:45.040925 23727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:45.041018 23727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:45.041041 23727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:45.041062 23727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:45.041091 23727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 21:04:45.041121 23727 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 21:04:45.041142 23727 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37015/jwks.json
I20260810 21:04:45.042671 23727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:34877
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:34877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37015/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:45.043148 23727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:45.043551 23727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:45.049201 23734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:45.049378 23727 server_base.cc:1034] running on GCE node
W20260810 21:04:45.049186 23732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:45.049180 23737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:45.049831 23727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:45.050194 23727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:45.051380 23727 hybrid_clock.cc:648] HybridClock initialized: now 1786395885051374 us; error 43 us; skew 500 ppm
I20260810 21:04:45.052893 23727 webserver.cc:460] Webserver started at http://127.15.37.62:35723/ using document root <none> and password file <none>
I20260810 21:04:45.053159 23727 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:45.053234 23727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:45.053390 23727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:45.054548 23727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "4b2611d6a25c4cdc9fcd7155b57ccd2a"
format_stamp: "Formatted at 2026-08-10 21:04:45 on dist-test-slave-jq4t"
server_key: "580d57649e09ad59cd2e4d9c50912313"
server_key_iv: "1610ae886d1ea428bc1dd69d12c915aa"
server_key_version: "encryptionkey@0"
I20260810 21:04:45.054952 23727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "4b2611d6a25c4cdc9fcd7155b57ccd2a"
format_stamp: "Formatted at 2026-08-10 21:04:45 on dist-test-slave-jq4t"
server_key: "580d57649e09ad59cd2e4d9c50912313"
server_key_iv: "1610ae886d1ea428bc1dd69d12c915aa"
server_key_version: "encryptionkey@0"
I20260810 21:04:45.056362 23727 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:04:45.057278 23748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:45.057485 23727 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:45.057612 23727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "4b2611d6a25c4cdc9fcd7155b57ccd2a"
format_stamp: "Formatted at 2026-08-10 21:04:45 on dist-test-slave-jq4t"
server_key: "580d57649e09ad59cd2e4d9c50912313"
server_key_iv: "1610ae886d1ea428bc1dd69d12c915aa"
server_key_version: "encryptionkey@0"
I20260810 21:04:45.057694 23727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:45.075603 23727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:45.076012 23727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:45.076195 23727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:45.080626 23727 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:34877
I20260810 21:04:45.080706 23824 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:34877 every 8 connection(s)
I20260810 21:04:45.081095 23727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:45.081887 23825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:45.085040 23825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a: Bootstrap starting.
I20260810 21:04:45.085692 23825 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:45.086019 23825 log.cc:824] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:45.086808 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 23727
I20260810 21:04:45.086937 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:45.086951 23825 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a: No bootstrap required, opened a new log
I20260810 21:04:45.087116 15508 external_mini_cluster.cc:1428] Setting key 72277d4eb4238773e70467b67abb0939
I20260810 21:04:45.089790 23825 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b2611d6a25c4cdc9fcd7155b57ccd2a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34877 } }
I20260810 21:04:45.089968 23825 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:45.090047 23825 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b2611d6a25c4cdc9fcd7155b57ccd2a, State: Initialized, Role: FOLLOWER
I20260810 21:04:45.090231 23825 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b2611d6a25c4cdc9fcd7155b57ccd2a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34877 } }
I20260810 21:04:45.090335 23825 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:45.090382 23825 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:45.090431 23825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:45.091063 23825 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b2611d6a25c4cdc9fcd7155b57ccd2a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34877 } }
I20260810 21:04:45.091193 23825 leader_election.cc:302] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b2611d6a25c4cdc9fcd7155b57ccd2a; no voters:
I20260810 21:04:45.091403 23825 leader_election.cc:288] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:45.091426 23833 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:45.091552 23833 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [term 1 LEADER]: Becoming Leader. State: Replica: 4b2611d6a25c4cdc9fcd7155b57ccd2a, State: Running, Role: LEADER
I20260810 21:04:45.091694 23825 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:45.091691 23833 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b2611d6a25c4cdc9fcd7155b57ccd2a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34877 } }
I20260810 21:04:45.092152 23834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b2611d6a25c4cdc9fcd7155b57ccd2a. Latest consensus state: current_term: 1 leader_uuid: "4b2611d6a25c4cdc9fcd7155b57ccd2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b2611d6a25c4cdc9fcd7155b57ccd2a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34877 } } }
I20260810 21:04:45.092464 23834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:45.092746 23835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b2611d6a25c4cdc9fcd7155b57ccd2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b2611d6a25c4cdc9fcd7155b57ccd2a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34877 } } }
I20260810 21:04:45.092787 23847 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:45.092868 23835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:45.093375 23831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:45.087675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38774 (local address 127.15.37.62:34877)
0810 21:04:45.087920 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:45.087927 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:45.087953 (+ 26us) server_negotiation.cc:407] Connection header received
0810 21:04:45.088434 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:45.088440 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:45.088558 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:45.088683 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:45.088973 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:45.089929 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:45.090929 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:45.091464 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:45.091591 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:45.092379 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:45.092384 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:45.092384 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:45.092638 (+ 254us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:45.092688 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:45.092704 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:45.092770 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:45.093080 (+ 310us) server_negotiation.cc:299] Negotiation successful
0810 21:04:45.093171 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":116,"threads_started":1}
I20260810 21:04:45.093724 23847 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:45.094388 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:04:45.097671 23847 catalog_manager.cc:1347] Generated new cluster ID: 6ef33d356705494986ce645a482c6612
I20260810 21:04:45.097736 23847 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:04:45.102787 23847 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:45.103322 23847 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:45.109730 23847 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b2611d6a25c4cdc9fcd7155b57ccd2a: Generated new TSK 0
I20260810 21:04:45.109943 23847 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:04:45.121774 23831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:45.118101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38790 (local address 127.15.37.62:34877)
0810 21:04:45.118154 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:45.118156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:45.118238 (+ 82us) server_negotiation.cc:407] Connection header received
0810 21:04:45.118341 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:45.118342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:45.118356 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:45.118449 (+ 93us) server_negotiation.cc:226] Negotiated authn=JWT
0810 21:04:45.118607 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:45.119140 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:45.120008 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:45.120283 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:45.120365 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:45.120632 (+ 267us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 21:04:45.121522 (+ 890us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37015/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 21:04:45.121689 (+ 167us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38790: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37015/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":28}
W20260810 21:04:45.121852 23831 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38790: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37015/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260810 21:04:45.121853 23865 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:04:45.117992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34877 (local address 127.0.0.1:38790)
0810 21:04:45.118150 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:45.118164 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:45.118259 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:45.118447 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:45.118448 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:45.118450 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0810 21:04:45.118515 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:45.118518 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:45.119239 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:45.119240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:45.119898 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:45.119900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:45.120374 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:45.120376 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:45.120441 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:45.120449 (+ 8us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 21:04:45.121637 (+ 1188us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37015/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 21:04:45.121742 (+ 105us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.37.62:34877: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37015/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":89,"threads_started":1}
I20260810 21:04:45.122125 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 23727
E20260810 21:04:45.150142 23867 webserver.cc:533] Webserver: sslize failed:
E20260810 21:04:45.150259 23867 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-10T21:04:45Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (237 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-10T21:04:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:45Z Disabled control of system clock
I20260810 21:04:45.186550 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:36675
--webserver_interface=127.15.37.62
--webserver_port=0
--builtin_ntp_servers=127.15.37.20:34569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:36675
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/testchainca.cert with env {}
W20260810 21:04:45.276402 23876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:45.276654 23876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:45.276676 23876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:45.277956 23876 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:45.278002 23876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:45.278014 23876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:45.278067 23876 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:45.278088 23876 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 21:04:45.278110 23876 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 21:04:45.278136 23876 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260810 21:04:45.279706 23876 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:36675
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:36675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:45.279933 23876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:45.280114 23876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:45.285399 23883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:45.285413 23884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:45.285429 23886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:45.285655 23876 server_base.cc:1034] running on GCE node
I20260810 21:04:45.285962 23876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:45.286293 23876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:45.287506 23876 hybrid_clock.cc:648] HybridClock initialized: now 1786395885287480 us; error 38 us; skew 500 ppm
I20260810 21:04:45.288957 23876 webserver.cc:460] Webserver started at http://127.15.37.62:35699/ using document root <none> and password file <none>
I20260810 21:04:45.289247 23876 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:45.289324 23876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:45.289489 23876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:45.290701 23876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "b8d2e4d2133f400e8e3ce37356cfacf9"
format_stamp: "Formatted at 2026-08-10 21:04:45 on dist-test-slave-jq4t"
server_key: "50eb1ea7fc7cd6b2fa6dba130a97ea2c"
server_key_iv: "7a5766fe0120953373bb28c4837c626c"
server_key_version: "encryptionkey@0"
I20260810 21:04:45.291118 23876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "b8d2e4d2133f400e8e3ce37356cfacf9"
format_stamp: "Formatted at 2026-08-10 21:04:45 on dist-test-slave-jq4t"
server_key: "50eb1ea7fc7cd6b2fa6dba130a97ea2c"
server_key_iv: "7a5766fe0120953373bb28c4837c626c"
server_key_version: "encryptionkey@0"
I20260810 21:04:45.292605 23876 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260810 21:04:45.293458 23893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:45.293663 23876 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:45.293776 23876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "b8d2e4d2133f400e8e3ce37356cfacf9"
format_stamp: "Formatted at 2026-08-10 21:04:45 on dist-test-slave-jq4t"
server_key: "50eb1ea7fc7cd6b2fa6dba130a97ea2c"
server_key_iv: "7a5766fe0120953373bb28c4837c626c"
server_key_version: "encryptionkey@0"
I20260810 21:04:45.293854 23876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:45.304328 23876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:45.304760 23876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:45.304939 23876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:45.309722 23876 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:36675
I20260810 21:04:45.309811 23971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:36675 every 8 connection(s)
I20260810 21:04:45.310228 23876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:45.311406 23972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:45.312386 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 23876
I20260810 21:04:45.312543 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:45.312727 15508 external_mini_cluster.cc:1428] Setting key 7ac1348dd656fc98d047903920bdc006
I20260810 21:04:45.314726 23972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9: Bootstrap starting.
I20260810 21:04:45.315500 23972 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:45.315831 23972 log.cc:824] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:45.316656 23972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9: No bootstrap required, opened a new log
I20260810 21:04:45.319108 23972 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8d2e4d2133f400e8e3ce37356cfacf9" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36675 } }
I20260810 21:04:45.319339 23972 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:45.319406 23972 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d2e4d2133f400e8e3ce37356cfacf9, State: Initialized, Role: FOLLOWER
I20260810 21:04:45.319557 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:45.313444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47310 (local address 127.15.37.62:36675)
0810 21:04:45.313696 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:45.313705 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:45.313741 (+ 36us) server_negotiation.cc:407] Connection header received
0810 21:04:45.314411 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:45.314421 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:45.314506 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:45.314668 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:45.314910 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:45.316324 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:45.317222 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:45.317859 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:45.317996 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:45.318759 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:45.318764 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:45.318765 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:04:45.318987 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:45.319045 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:04:45.319061 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:45.319137 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:45.319199 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 21:04:45.319288 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":110,"threads_started":1}
I20260810 21:04:45.319563 23972 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8d2e4d2133f400e8e3ce37356cfacf9" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36675 } }
I20260810 21:04:45.319670 23972 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:45.319710 23972 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:45.319780 23972 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:45.320665 23972 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8d2e4d2133f400e8e3ce37356cfacf9" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36675 } }
I20260810 21:04:45.320783 23972 leader_election.cc:302] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8d2e4d2133f400e8e3ce37356cfacf9; no voters:
I20260810 21:04:45.320874 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:04:45.320990 23972 leader_election.cc:288] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:45.321070 23980 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:45.321260 23980 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [term 1 LEADER]: Becoming Leader. State: Replica: b8d2e4d2133f400e8e3ce37356cfacf9, State: Running, Role: LEADER
I20260810 21:04:45.321291 23972 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:45.321419 23980 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8d2e4d2133f400e8e3ce37356cfacf9" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36675 } }
I20260810 21:04:45.321928 23981 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8d2e4d2133f400e8e3ce37356cfacf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8d2e4d2133f400e8e3ce37356cfacf9" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36675 } } }
I20260810 21:04:45.322014 23981 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:45.322459 23992 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:45.322794 23983 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8d2e4d2133f400e8e3ce37356cfacf9. Latest consensus state: current_term: 1 leader_uuid: "b8d2e4d2133f400e8e3ce37356cfacf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8d2e4d2133f400e8e3ce37356cfacf9" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36675 } } }
I20260810 21:04:45.322901 23983 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:45.323032 23992 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:45.324922 23992 catalog_manager.cc:1347] Generated new cluster ID: 8ae05ab2c3a84eb09a7e9d855f703595
I20260810 21:04:45.325001 23992 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:04:45.335551 23992 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:45.336118 23992 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:45.346375 23992 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8d2e4d2133f400e8e3ce37356cfacf9: Generated new TSK 0
I20260810 21:04:45.346638 23992 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:04:45.788630 23978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:45.358152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47324 (local address 127.15.37.62:36675)
0810 21:04:45.358219 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:45.358221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:45.358330 (+ 109us) server_negotiation.cc:407] Connection header received
0810 21:04:45.358400 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:45.358401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:45.358415 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:45.358507 (+ 92us) server_negotiation.cc:226] Negotiated authn=JWT
0810 21:04:45.358701 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:45.359539 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:45.360392 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:45.360777 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:45.360883 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:45.361079 (+ 196us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 21:04:45.788293 (+427214us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 21:04:45.788552 (+ 259us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:47324: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":37}
W20260810 21:04:45.788707 23978 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:47324: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260810 21:04:45.788852 24011 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:04:45.358051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36675 (local address 127.0.0.1:47324)
0810 21:04:45.358248 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:45.358266 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:45.358334 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:45.358546 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:45.358547 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:45.358551 (+ 4us) client_negotiation.cc:189] Negotiated authn=JWT
0810 21:04:45.358616 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:45.358619 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:45.359649 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:45.359650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:45.360298 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:45.360299 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:45.360883 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:45.360885 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:45.360944 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:45.360951 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 21:04:45.788543 (+427592us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 21:04:45.788715 (+ 172us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.15.37.62:36675: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":116,"threads_started":1}
I20260810 21:04:45.789266 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 23876
2026-08-10T21:04:45Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (643 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (99 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (96 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:04:46 dist-test-slave-jq4t krb5kdc[24028](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:04:46 dist-test-slave-jq4t krb5kdc[24028](info): set up 2 sockets
Aug 10 21:04:46 dist-test-slave-jq4t krb5kdc[24028](info): commencing operation
krb5kdc: starting...
W20260810 21:04:47.270255 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:04:47 dist-test-slave-jq4t krb5kdc[24028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:04:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:04:47.407686 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:38607
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:38607
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:47.495692 24043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:47.495937 24043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:47.495963 24043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:47.497247 24043 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:47.497298 24043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:47.497313 24043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:47.497326 24043 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:47.497339 24043 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:47.498893 24043 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:38607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:38607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:47.499135 24043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:47.499341 24043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:47.505057 24051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:47.505057 24054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:47.505107 24043 server_base.cc:1034] running on GCE node
W20260810 21:04:47.505057 24049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:47.505565 24043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:47.505949 24043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:47.507130 24043 hybrid_clock.cc:648] HybridClock initialized: now 1786395887507125 us; error 41 us; skew 500 ppm
Aug 10 21:04:47 dist-test-slave-jq4t krb5kdc[24028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395887, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:47.513134 24043 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:04:47.513724 24043 webserver.cc:460] Webserver started at http://127.15.37.62:34469/ using document root <none> and password file <none>
I20260810 21:04:47.514027 24043 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:47.514101 24043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:47.514213 24043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:47.515359 24043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "eebe9b236d094818a8aa662403de6f69"
format_stamp: "Formatted at 2026-08-10 21:04:47 on dist-test-slave-jq4t"
server_key: "be2b7bff50c9efabd4b24201d1cdd91e"
server_key_iv: "e7e7c125fa2687e7a4ecd5678b9d34c0"
server_key_version: "encryptionkey@0"
I20260810 21:04:47.515693 24043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "eebe9b236d094818a8aa662403de6f69"
format_stamp: "Formatted at 2026-08-10 21:04:47 on dist-test-slave-jq4t"
server_key: "be2b7bff50c9efabd4b24201d1cdd91e"
server_key_iv: "e7e7c125fa2687e7a4ecd5678b9d34c0"
server_key_version: "encryptionkey@0"
I20260810 21:04:47.517644 24043 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 21:04:47.518559 24064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:47.518978 24043 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:47.519107 24043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "eebe9b236d094818a8aa662403de6f69"
format_stamp: "Formatted at 2026-08-10 21:04:47 on dist-test-slave-jq4t"
server_key: "be2b7bff50c9efabd4b24201d1cdd91e"
server_key_iv: "e7e7c125fa2687e7a4ecd5678b9d34c0"
server_key_version: "encryptionkey@0"
I20260810 21:04:47.519209 24043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:47.571692 24043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:47.574331 24043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:47.574460 24043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:47.579012 24043 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:38607
I20260810 21:04:47.579111 24131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:38607 every 8 connection(s)
I20260810 21:04:47.579475 24043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:47.580541 24132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:47.583101 24132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69: Bootstrap starting.
I20260810 21:04:47.583792 24132 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:47.584141 24132 log.cc:824] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:47.585053 24132 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69: No bootstrap required, opened a new log
I20260810 21:04:47.585325 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 24043
I20260810 21:04:47.585417 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:47.585644 15508 external_mini_cluster.cc:1428] Setting key 940151d57ae3c581fe98682bfbe7f334
I20260810 21:04:47.587664 24132 raft_consensus.cc:348] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eebe9b236d094818a8aa662403de6f69" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38607 } }
I20260810 21:04:47.587896 24132 raft_consensus.cc:374] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:47.587944 24132 raft_consensus.cc:729] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eebe9b236d094818a8aa662403de6f69, State: Initialized, Role: FOLLOWER
I20260810 21:04:47.588083 24132 consensus_queue.cc:260] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eebe9b236d094818a8aa662403de6f69" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38607 } }
I20260810 21:04:47.588176 24132 raft_consensus.cc:388] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:47.588201 24132 raft_consensus.cc:482] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:47.588269 24132 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:47.589751 24132 raft_consensus.cc:504] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eebe9b236d094818a8aa662403de6f69" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38607 } }
I20260810 21:04:47.589905 24132 leader_election.cc:302] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eebe9b236d094818a8aa662403de6f69; no voters:
I20260810 21:04:47.590096 24132 leader_election.cc:288] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:47.590186 24140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:47.590368 24132 sys_catalog.cc:564] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:47.590394 24140 raft_consensus.cc:686] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [term 1 LEADER]: Becoming Leader. State: Replica: eebe9b236d094818a8aa662403de6f69, State: Running, Role: LEADER
I20260810 21:04:47.590587 24140 consensus_queue.cc:237] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eebe9b236d094818a8aa662403de6f69" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38607 } }
I20260810 21:04:47.591012 24141 sys_catalog.cc:455] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eebe9b236d094818a8aa662403de6f69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eebe9b236d094818a8aa662403de6f69" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38607 } } }
I20260810 21:04:47.591112 24141 sys_catalog.cc:458] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:47.591295 24143 sys_catalog.cc:455] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eebe9b236d094818a8aa662403de6f69. Latest consensus state: current_term: 1 leader_uuid: "eebe9b236d094818a8aa662403de6f69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eebe9b236d094818a8aa662403de6f69" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 38607 } } }
I20260810 21:04:47.591352 24143 sys_catalog.cc:458] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:47.591761 24151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:47.592348 24151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:47.594614 24151 catalog_manager.cc:1347] Generated new cluster ID: cf6db96b60ee4651bd6181eec58dc91e
I20260810 21:04:47.594682 24151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:04:47 dist-test-slave-jq4t krb5kdc[24028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:47.599915 24139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:47.586259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57268 (local address 127.15.37.62:38607)
0810 21:04:47.586531 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:47.586542 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:47.586583 (+ 41us) server_negotiation.cc:407] Connection header received
0810 21:04:47.587601 (+ 1018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:47.587613 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:47.587693 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:47.587873 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:47.588898 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:47.590443 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:47.591758 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:47.592415 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:47.592920 (+ 505us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:47.595725 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:47.595730 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:47.595730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:47.595745 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:47.597981 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:47.598430 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:47.598435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:47.598436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:47.598586 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:47.598810 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:47.598811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:47.598811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:47.599241 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:47.599438 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:47.599516 (+ 78us) server_negotiation.cc:299] Negotiation successful
0810 21:04:47.599677 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":128,"threads_started":1}
I20260810 21:04:47.615469 24151 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:47.616101 24151 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:47.622666 24151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eebe9b236d094818a8aa662403de6f69: Generated new TSK 0
I20260810 21:04:47.622905 24151 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:04:47.660562 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38607
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:47.778047 24171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:47.778283 24171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:47.778309 24171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:47.779444 24171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:47.779481 24171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:47.779507 24171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:04:47.781013 24171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:47.781235 24171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:47.781435 24171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:47.786888 24177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:47.786902 24180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:47.786906 24178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:47.787101 24171 server_base.cc:1034] running on GCE node
I20260810 21:04:47.787410 24171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:47.787678 24171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:47.788851 24171 hybrid_clock.cc:648] HybridClock initialized: now 1786395887788834 us; error 50 us; skew 500 ppm
Aug 10 21:04:47 dist-test-slave-jq4t krb5kdc[24028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395887, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:47.791676 24171 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:04:47.792249 24171 webserver.cc:460] Webserver started at http://127.15.37.1:34629/ using document root <none> and password file <none>
I20260810 21:04:47.792591 24171 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:47.792665 24171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:47.792815 24171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:47.794531 24171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "701c25fdb581433fa9ba45e44a5b22dd"
format_stamp: "Formatted at 2026-08-10 21:04:47 on dist-test-slave-jq4t"
server_key: "0ef9bc9d4d2fbdae414b5322e3f04b00"
server_key_iv: "90accdaf6b2050ae34dd7bab2a93bb7d"
server_key_version: "encryptionkey@0"
I20260810 21:04:47.795029 24171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "701c25fdb581433fa9ba45e44a5b22dd"
format_stamp: "Formatted at 2026-08-10 21:04:47 on dist-test-slave-jq4t"
server_key: "0ef9bc9d4d2fbdae414b5322e3f04b00"
server_key_iv: "90accdaf6b2050ae34dd7bab2a93bb7d"
server_key_version: "encryptionkey@0"
I20260810 21:04:47.801034 24171 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260810 21:04:47.802045 24187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:47.802271 24171 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:47.802399 24171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "701c25fdb581433fa9ba45e44a5b22dd"
format_stamp: "Formatted at 2026-08-10 21:04:47 on dist-test-slave-jq4t"
server_key: "0ef9bc9d4d2fbdae414b5322e3f04b00"
server_key_iv: "90accdaf6b2050ae34dd7bab2a93bb7d"
server_key_version: "encryptionkey@0"
I20260810 21:04:47.802493 24171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:47.829771 24171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:47.832338 24171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:47.832541 24171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:47.832828 24171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:47.833199 24171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:47.833258 24171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:47.833302 24171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:47.833331 24171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:47.840212 24171 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:33673
I20260810 21:04:47.840262 24348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:33673 every 8 connection(s)
I20260810 21:04:47.840693 24171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
Aug 10 21:04:47 dist-test-slave-jq4t krb5kdc[24028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395887, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:47.852144 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 24171
I20260810 21:04:47.852269 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:04:47.852568 15508 external_mini_cluster.cc:1428] Setting key 24d396b7670597846b617908c9da612a
I20260810 21:04:47.852871 24139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:47.841650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:52129 (local address 127.15.37.62:38607)
0810 21:04:47.841714 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:47.841716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:47.841939 (+ 223us) server_negotiation.cc:407] Connection header received
0810 21:04:47.842902 (+ 963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:47.842904 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:47.842924 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:47.843013 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:47.843638 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:47.844555 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:47.845868 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:47.846211 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:47.846256 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:47.849108 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:47.849110 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:47.849111 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:47.849124 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:47.850831 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:47.851517 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:47.851518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:47.851519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:47.851589 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:47.851895 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:47.851896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:47.851897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:47.852067 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:47.852124 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:47.852605 (+ 481us) server_negotiation.cc:299] Negotiation successful
0810 21:04:47.852723 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 21:04:47.853480 24351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:47.841602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:38607 (local address 127.15.37.1:52129)
0810 21:04:47.841779 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:47.841825 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:47.842775 (+ 950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:47.843067 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:47.843070 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:47.843336 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:47.843541 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:47.843545 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:47.844645 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:47.844646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:47.845743 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:47.845747 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:47.846360 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:47.846361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:47.846512 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:47.847170 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:47.847181 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:47.848979 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:47.850935 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:47.850946 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:47.850948 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:47.851393 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:47.851663 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:47.851664 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:47.851665 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:47.851807 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:47.852179 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:47.852187 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:47.852399 (+ 212us) client_negotiation.cc:769] Sending connection context
0810 21:04:47.852981 (+ 582us) client_negotiation.cc:240] Negotiation successful
0810 21:04:47.853199 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":98,"threads_started":1}
I20260810 21:04:47.855446 24349 heartbeater.cc:347] Connected to a master server at 127.15.37.62:38607
I20260810 21:04:47.855578 24349 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:47.855808 24349 heartbeater.cc:511] Master 127.15.37.62:38607 requested a full tablet report, sending...
I20260810 21:04:47.856406 24087 ts_manager.cc:194] Registered new tserver with Master: 701c25fdb581433fa9ba45e44a5b22dd (127.15.37.1:33673)
I20260810 21:04:47.857116 24087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:52129
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:04:47.887866 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38607
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:47.990931 24355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:47.991153 24355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:47.991178 24355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:47.992453 24355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:47.992574 24355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:47.992605 24355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:04:47.994159 24355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:47.994421 24355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:47.994694 24355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:48.000239 24368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:48.000234 24363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:48.000234 24365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:48.000595 24355 server_base.cc:1034] running on GCE node
I20260810 21:04:48.000856 24355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:48.001116 24355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:48.002269 24355 hybrid_clock.cc:648] HybridClock initialized: now 1786395888002245 us; error 41 us; skew 500 ppm
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:48.005026 24355 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:04:48.005601 24355 webserver.cc:460] Webserver started at http://127.15.37.2:45031/ using document root <none> and password file <none>
I20260810 21:04:48.005851 24355 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:48.005898 24355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:48.006053 24355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:48.007234 24355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "64da8303c56445d59bb7e87a30018aaa"
format_stamp: "Formatted at 2026-08-10 21:04:48 on dist-test-slave-jq4t"
server_key: "7bf6697133a4732b4abad3190648310b"
server_key_iv: "51deab0cb6613557ec6fa575390d2ad1"
server_key_version: "encryptionkey@0"
I20260810 21:04:48.007620 24355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "64da8303c56445d59bb7e87a30018aaa"
format_stamp: "Formatted at 2026-08-10 21:04:48 on dist-test-slave-jq4t"
server_key: "7bf6697133a4732b4abad3190648310b"
server_key_iv: "51deab0cb6613557ec6fa575390d2ad1"
server_key_version: "encryptionkey@0"
I20260810 21:04:48.009155 24355 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:48.009939 24379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:48.010104 24355 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 21:04:48.010201 24355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "64da8303c56445d59bb7e87a30018aaa"
format_stamp: "Formatted at 2026-08-10 21:04:48 on dist-test-slave-jq4t"
server_key: "7bf6697133a4732b4abad3190648310b"
server_key_iv: "51deab0cb6613557ec6fa575390d2ad1"
server_key_version: "encryptionkey@0"
I20260810 21:04:48.010262 24355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:48.022744 24355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:48.025466 24355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:48.025661 24355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:48.025943 24355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:48.026295 24355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:48.026358 24355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:48.026396 24355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:48.026445 24355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:48.032752 24355 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:44569
I20260810 21:04:48.032842 24544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:44569 every 8 connection(s)
I20260810 21:04:48.033239 24355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:04:48.035337 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 24355
I20260810 21:04:48.035465 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:04:48.035684 15508 external_mini_cluster.cc:1428] Setting key 51dc435b198e59016090f9332c621b21
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:48.045245 24547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:48.034055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:38607 (local address 127.15.37.2:54609)
0810 21:04:48.034247 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:48.034295 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:48.035395 (+ 1100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:48.035820 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:48.035824 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:48.036219 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:48.036532 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:48.036539 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.037299 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.037300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:48.038677 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:48.038681 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.039223 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.039224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:48.039332 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:48.039953 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:48.039962 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:48.041740 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:48.043738 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:48.043745 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:48.043747 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:48.043998 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:48.044236 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:48.044236 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:48.044237 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:48.044338 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:48.044689 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:48.044695 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:48.044824 (+ 129us) client_negotiation.cc:769] Sending connection context
0810 21:04:48.044932 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 21:04:48.045065 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":109,"threads_started":1}
I20260810 21:04:48.045235 24139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:48.034115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:54609 (local address 127.15.37.62:38607)
0810 21:04:48.034190 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:48.034192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:48.034389 (+ 197us) server_negotiation.cc:407] Connection header received
0810 21:04:48.035551 (+ 1162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:48.035553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:48.035571 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:48.035606 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:48.036628 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.037188 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.038779 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.039129 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.039211 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:48.041848 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:48.041850 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:48.041851 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:48.041859 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:48.043647 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:48.044084 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:48.044086 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:48.044086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:48.044161 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:48.044410 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:48.044411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:48.044411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:48.044616 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:48.044696 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:48.045003 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 21:04:48.045110 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 21:04:48.045856 24545 heartbeater.cc:347] Connected to a master server at 127.15.37.62:38607
I20260810 21:04:48.045964 24545 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
I20260810 21:04:48.046164 24545 heartbeater.cc:511] Master 127.15.37.62:38607 requested a full tablet report, sending...
I20260810 21:04:48.046624 24087 ts_manager.cc:194] Registered new tserver with Master: 64da8303c56445d59bb7e87a30018aaa (127.15.37.2:44569)
I20260810 21:04:48.047024 24087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:54609
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:04:48.067373 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38607
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:48.154753 24551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:48.155037 24551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:48.155081 24551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:48.156291 24551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:48.156376 24551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:48.156422 24551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:04:48.158087 24551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:38607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:48.158411 24551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:48.158674 24551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:48.164347 24559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:48.164534 24551 server_base.cc:1034] running on GCE node
W20260810 21:04:48.164361 24562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:48.164387 24557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:48.164870 24551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:48.165123 24551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:48.166301 24551 hybrid_clock.cc:648] HybridClock initialized: now 1786395888166278 us; error 39 us; skew 500 ppm
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:48.169459 24551 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:04:48.170039 24551 webserver.cc:460] Webserver started at http://127.15.37.3:35541/ using document root <none> and password file <none>
I20260810 21:04:48.170341 24551 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:48.170428 24551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:48.170598 24551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:48.171756 24551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "8e906f0471424828b1f3f1a09d9d3fae"
format_stamp: "Formatted at 2026-08-10 21:04:48 on dist-test-slave-jq4t"
server_key: "1920c52222a3a385712dc7b398ce1241"
server_key_iv: "e744831a0f4af910b93a23b0a08020c3"
server_key_version: "encryptionkey@0"
I20260810 21:04:48.172165 24551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "8e906f0471424828b1f3f1a09d9d3fae"
format_stamp: "Formatted at 2026-08-10 21:04:48 on dist-test-slave-jq4t"
server_key: "1920c52222a3a385712dc7b398ce1241"
server_key_iv: "e744831a0f4af910b93a23b0a08020c3"
server_key_version: "encryptionkey@0"
I20260810 21:04:48.173833 24551 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:48.174701 24574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:48.174882 24551 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:48.174997 24551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "8e906f0471424828b1f3f1a09d9d3fae"
format_stamp: "Formatted at 2026-08-10 21:04:48 on dist-test-slave-jq4t"
server_key: "1920c52222a3a385712dc7b398ce1241"
server_key_iv: "e744831a0f4af910b93a23b0a08020c3"
server_key_version: "encryptionkey@0"
I20260810 21:04:48.175089 24551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:48.188704 24551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:48.191262 24551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:48.191465 24551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:48.191792 24551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:48.192153 24551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:48.192220 24551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:48.192265 24551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:48.192293 24551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:48.200831 24551 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:39283
I20260810 21:04:48.200875 24730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:39283 every 8 connection(s)
I20260810 21:04:48.201261 24551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:04:48.203680 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 24551
I20260810 21:04:48.203792 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:04:48.203995 15508 external_mini_cluster.cc:1428] Setting key 330aef08088989af5b07ed99b2e4386b
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:04:48.212285 24139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:48.202209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:52695 (local address 127.15.37.62:38607)
0810 21:04:48.202264 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:48.202266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:48.202477 (+ 211us) server_negotiation.cc:407] Connection header received
0810 21:04:48.203474 (+ 997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:48.203476 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:48.203488 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:48.203544 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:48.204454 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.205287 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.206578 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.206783 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.206865 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:48.209421 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:48.209423 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:48.209423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:48.209432 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:48.210890 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:48.211337 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:48.211339 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:48.211339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:48.211417 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:48.211678 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:48.211679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:48.211680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:48.211810 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:48.211871 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:48.212132 (+ 261us) server_negotiation.cc:299] Negotiation successful
0810 21:04:48.212211 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 21:04:48.212523 24736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:48.202176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:38607 (local address 127.15.37.3:52695)
0810 21:04:48.202346 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:48.202392 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:48.203358 (+ 966us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:48.203636 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:48.203641 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:48.204067 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:48.204322 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:48.204328 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.205398 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.205400 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:48.206448 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:48.206451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.206889 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.206890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:48.207023 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:48.207694 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:48.207703 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:48.209284 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:48.210983 (+ 1699us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:48.210991 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:48.210994 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:48.211245 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:48.211494 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:48.211495 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:48.211495 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:48.211616 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:48.211866 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:48.211871 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:48.212006 (+ 135us) client_negotiation.cc:769] Sending connection context
0810 21:04:48.212100 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 21:04:48.212239 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":90,"threads_started":1}
I20260810 21:04:48.213238 24734 heartbeater.cc:347] Connected to a master server at 127.15.37.62:38607
I20260810 21:04:48.213370 24734 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:48.213577 24734 heartbeater.cc:511] Master 127.15.37.62:38607 requested a full tablet report, sending...
I20260810 21:04:48.214046 24087 ts_manager.cc:194] Registered new tserver with Master: 8e906f0471424828b1f3f1a09d9d3fae (127.15.37.3:39283)
I20260810 21:04:48.214514 24087 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:52695
I20260810 21:04:48.216390 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/test-admin.keytab.
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:48.233809 15508 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260810 21:04:48.235601 24743 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:04:48.234844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38328 (local address 127.15.37.1:33673)
0810 21:04:48.235039 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:48.235043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:48.235055 (+ 12us) server_negotiation.cc:407] Connection header received
0810 21:04:48.235083 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:48.235085 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:48.235101 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:48.235175 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:48.235499 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38328: BlockingRecv error: recv got EOF from 127.0.0.1:38328 (error 108)
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":101,"threads_started":1}
W20260810 21:04:48.235713 15508 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/krb5cc)
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:48.236878 15508 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:48.237844 15508 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.1@KRBTEST.COM
I20260810 21:04:48.246927 24743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:48.238488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38340 (local address 127.15.37.1:33673)
0810 21:04:48.238584 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:48.238587 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:48.238682 (+ 95us) server_negotiation.cc:407] Connection header received
0810 21:04:48.238807 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:48.238808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:48.238822 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:48.238900 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:48.239358 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.240157 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.241001 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.241361 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.241466 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:48.243779 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:48.243790 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:48.243790 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:48.243798 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:48.245586 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:48.246011 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:48.246015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:48.246015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:48.246074 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:48.246295 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:48.246296 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:48.246297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:48.246487 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:48.246668 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:48.246719 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 21:04:48.246812 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260810 21:04:48.248821 24743 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:04:48.248232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38342 (local address 127.15.37.1:33673)
0810 21:04:48.248286 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:48.248288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:48.248299 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:04:48.248354 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:48.248355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:48.248365 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:48.248414 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:48.248765 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38342: BlockingRecv error: recv got EOF from 127.0.0.1:38342 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260810 21:04:48.248924 15508 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/krb5cc' of type FILE
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:48.249982 15508 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:48.250871 15508 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.1@KRBTEST.COM
I20260810 21:04:48.257936 24743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:48.251487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38348 (local address 127.15.37.1:33673)
0810 21:04:48.251541 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:48.251543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:48.251573 (+ 30us) server_negotiation.cc:407] Connection header received
0810 21:04:48.251641 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:48.251641 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:48.251651 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:48.251702 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:48.252055 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.252625 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.253300 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.253508 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.253559 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:48.255672 (+ 2113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:48.255673 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:48.255673 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:48.255679 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:48.257009 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:48.257324 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:48.257325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:48.257326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:48.257375 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:48.257538 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:48.257539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:48.257539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:48.257646 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:48.257721 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:48.257805 (+ 84us) server_negotiation.cc:299] Negotiation successful
0810 21:04:48.257868 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260810 21:04:48.259718 24743 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:04:48.259072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38358 (local address 127.15.37.1:33673)
0810 21:04:48.259124 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:48.259126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:48.259227 (+ 101us) server_negotiation.cc:407] Connection header received
0810 21:04:48.259302 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:48.259303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:48.259314 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:48.259370 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:48.259663 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38358: BlockingRecv error: recv got EOF from 127.0.0.1:38358 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260810 21:04:48.259804 15508 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786395855004795-15508-0/krb5kdc/krb5cc' of type FILE
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:48.260915 15508 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:48.261818 15508 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24028](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.1@KRBTEST.COM
I20260810 21:04:48.268989 24743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:48.262397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38364 (local address 127.15.37.1:33673)
0810 21:04:48.262456 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:48.262458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:48.262505 (+ 47us) server_negotiation.cc:407] Connection header received
0810 21:04:48.262590 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:48.262592 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:48.262601 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:48.262655 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:48.263068 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.263549 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.264282 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:48.264529 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:48.264614 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:48.266704 (+ 2090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:48.266706 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:48.266706 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:48.266714 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:48.267912 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:48.268239 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:48.268240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:48.268240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:48.268289 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:48.268455 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:48.268456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:48.268456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:48.268640 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:48.268720 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:48.268835 (+ 115us) server_negotiation.cc:299] Negotiation successful
0810 21:04:48.268902 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 21:04:48.269693 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 24171
I20260810 21:04:48.290369 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 24355
I20260810 21:04:48.300592 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 24551
I20260810 21:04:48.310405 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 24043
2026-08-10T21:04:48Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2326 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24762](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24762](info): set up 2 sockets
Aug 10 21:04:48 dist-test-slave-jq4t krb5kdc[24762](info): commencing operation
krb5kdc: starting...
W20260810 21:04:49.610461 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:04:49 dist-test-slave-jq4t krb5kdc[24762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:04:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:49Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.62.keytab.
Entry for principal oryx/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.62.keytab.
I20260810 21:04:49.744266 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:34421
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.62.keytab
--principal=oryx/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:34421
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:49.831172 24777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:49.831463 24777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:49.831507 24777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:49.832770 24777 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:49.832854 24777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:49.832877 24777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:49.832901 24777 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:49.832933 24777 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:49.834820 24777 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:34421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.62.keytab
--principal=oryx/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:34421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:49.835204 24777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:49.835469 24777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:49.840883 24786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:49.840873 24788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:49.840873 24785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:49.840903 24777 server_base.cc:1034] running on GCE node
I20260810 21:04:49.841439 24777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:49.841771 24777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:49.842917 24777 hybrid_clock.cc:648] HybridClock initialized: now 1786395889842891 us; error 45 us; skew 500 ppm
Aug 10 21:04:49 dist-test-slave-jq4t krb5kdc[24762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395889, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:49.845937 24777 init.cc:377] Logged in from keytab as oryx/127.15.37.62@KRBTEST.COM (short username oryx)
I20260810 21:04:49.846446 24777 webserver.cc:460] Webserver started at http://127.15.37.62:45803/ using document root <none> and password file <none>
I20260810 21:04:49.846715 24777 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:49.846788 24777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:49.846952 24777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:49.848109 24777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "d91d286f2ad04cb6af2bbe5b590be3b5"
format_stamp: "Formatted at 2026-08-10 21:04:49 on dist-test-slave-jq4t"
server_key: "b1b36b56aa8aecd0edfd6eb65f6eca18"
server_key_iv: "83e0b595ae9ff159b18f86c09f6047e9"
server_key_version: "encryptionkey@0"
I20260810 21:04:49.848575 24777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "d91d286f2ad04cb6af2bbe5b590be3b5"
format_stamp: "Formatted at 2026-08-10 21:04:49 on dist-test-slave-jq4t"
server_key: "b1b36b56aa8aecd0edfd6eb65f6eca18"
server_key_iv: "83e0b595ae9ff159b18f86c09f6047e9"
server_key_version: "encryptionkey@0"
I20260810 21:04:49.850103 24777 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:49.850950 24800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:49.851154 24777 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:49.851270 24777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "d91d286f2ad04cb6af2bbe5b590be3b5"
format_stamp: "Formatted at 2026-08-10 21:04:49 on dist-test-slave-jq4t"
server_key: "b1b36b56aa8aecd0edfd6eb65f6eca18"
server_key_iv: "83e0b595ae9ff159b18f86c09f6047e9"
server_key_version: "encryptionkey@0"
I20260810 21:04:49.851351 24777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:49.868467 24777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:49.870756 24777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:49.870962 24777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:49.875322 24777 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:34421
I20260810 21:04:49.875363 24871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:34421 every 8 connection(s)
I20260810 21:04:49.875774 24777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:49.876971 24872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:49.879359 24872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5: Bootstrap starting.
I20260810 21:04:49.879964 24872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:49.880218 24872 log.cc:824] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:49.880609 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 24777
I20260810 21:04:49.880740 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:49.880975 15508 external_mini_cluster.cc:1428] Setting key 9b99417c80a0c6fac7d7449c7544e032
I20260810 21:04:49.881115 24872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5: No bootstrap required, opened a new log
I20260810 21:04:49.883076 24872 raft_consensus.cc:348] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } }
I20260810 21:04:49.883255 24872 raft_consensus.cc:374] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:49.883322 24872 raft_consensus.cc:729] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d91d286f2ad04cb6af2bbe5b590be3b5, State: Initialized, Role: FOLLOWER
I20260810 21:04:49.883473 24872 consensus_queue.cc:260] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } }
I20260810 21:04:49.883589 24872 raft_consensus.cc:388] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:49.883641 24872 raft_consensus.cc:482] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:49.883692 24872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:49.884732 24872 raft_consensus.cc:504] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } }
I20260810 21:04:49.884868 24872 leader_election.cc:302] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d91d286f2ad04cb6af2bbe5b590be3b5; no voters:
I20260810 21:04:49.885087 24872 leader_election.cc:288] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:49.885257 24879 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:49.885442 24879 raft_consensus.cc:686] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [term 1 LEADER]: Becoming Leader. State: Replica: d91d286f2ad04cb6af2bbe5b590be3b5, State: Running, Role: LEADER
I20260810 21:04:49.885578 24872 sys_catalog.cc:564] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:49.885603 24879 consensus_queue.cc:237] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } }
I20260810 21:04:49.886190 24880 sys_catalog.cc:455] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } }
I20260810 21:04:49.886302 24880 sys_catalog.cc:458] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:49.886199 24881 sys_catalog.cc:455] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d91d286f2ad04cb6af2bbe5b590be3b5. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } }
I20260810 21:04:49.886658 24881 sys_catalog.cc:458] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:49.886874 24888 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:49.887521 24888 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 21:04:49 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:49.889747 24888 catalog_manager.cc:1347] Generated new cluster ID: 4d1ff3fb82c349de81f5eb1bb9ef3da7
I20260810 21:04:49.889811 24888 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:04:49.893811 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:49.881556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37238 (local address 127.15.37.62:34421)
0810 21:04:49.881751 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:49.881759 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:49.881786 (+ 27us) server_negotiation.cc:407] Connection header received
0810 21:04:49.883063 (+ 1277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:49.883080 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:49.883142 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:49.883324 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:49.884129 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:49.885266 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:49.886335 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:49.887006 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:49.887134 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:49.890242 (+ 3108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:49.890253 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:49.890253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:49.890267 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:49.892018 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:49.892436 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:49.892441 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:49.892446 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:49.892615 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:49.892849 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:49.892850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:49.892850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:49.893134 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:49.893304 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:49.893417 (+ 113us) server_negotiation.cc:299] Negotiation successful
0810 21:04:49.893580 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":105,"threads_started":1}
I20260810 21:04:49.904178 24888 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:49.904883 24888 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:49.911356 24888 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5: Generated new TSK 0
I20260810 21:04:49.911593 24888 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab.
Entry for principal oryx/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab.
I20260810 21:04:49.947140 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:34421
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab
--principal=oryx/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:50.035737 24913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:50.035990 24913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:50.036020 24913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:50.037462 24913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:50.037515 24913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:50.037545 24913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:04:50.039170 24913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab
--principal=oryx/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:34421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:50.039484 24913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:50.039742 24913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:50.045298 24921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:50.045351 24923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:50.045296 24926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:50.045596 24913 server_base.cc:1034] running on GCE node
I20260810 21:04:50.045851 24913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:50.046109 24913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:50.047314 24913 hybrid_clock.cc:648] HybridClock initialized: now 1786395890047299 us; error 28 us; skew 500 ppm
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:50.050279 24913 init.cc:377] Logged in from keytab as oryx/127.15.37.1@KRBTEST.COM (short username oryx)
I20260810 21:04:50.050753 24913 webserver.cc:460] Webserver started at http://127.15.37.1:41711/ using document root <none> and password file <none>
I20260810 21:04:50.051055 24913 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:50.051133 24913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:50.051323 24913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:50.052843 24913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "5a1a81056be146be950c9c72216433a8"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "b9bf728579e78f56c8524c8668c2a78c"
server_key_iv: "f6ce362b6a005837749e8121175f545c"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.053265 24913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "5a1a81056be146be950c9c72216433a8"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "b9bf728579e78f56c8524c8668c2a78c"
server_key_iv: "f6ce362b6a005837749e8121175f545c"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.054744 24913 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:04:50.055559 24939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:50.055740 24913 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 21:04:50.055850 24913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "5a1a81056be146be950c9c72216433a8"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "b9bf728579e78f56c8524c8668c2a78c"
server_key_iv: "f6ce362b6a005837749e8121175f545c"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.055961 24913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:50.071651 24913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:50.074425 24913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:50.074622 24913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:50.074900 24913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:50.075263 24913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:50.075323 24913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:50.075367 24913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:50.075412 24913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:50.081653 24913 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:38509
I20260810 21:04:50.081745 25099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:38509 every 8 connection(s)
I20260810 21:04:50.082113 24913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:04:50.083470 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 24913
I20260810 21:04:50.083562 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:04:50.083779 15508 external_mini_cluster.cc:1428] Setting key 939558af53cda57ce27866ac42e88da6
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
WARNING: no policy specified for oryx/127.15.37.2@KRBTEST.COM; defaulting to no policy
I20260810 21:04:50.093514 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.083037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:39905 (local address 127.15.37.62:34421)
0810 21:04:50.083128 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.083132 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.083325 (+ 193us) server_negotiation.cc:407] Connection header received
0810 21:04:50.083972 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.083975 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.083995 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.084062 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.085163 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.085773 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.087046 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.087286 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.087370 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.090108 (+ 2738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.090110 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.090111 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.090119 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.091766 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.092323 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.092324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.092325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.092387 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.092738 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.092739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.092739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.092863 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.092921 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.093323 (+ 402us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.093429 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 21:04:50.093740 25107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.082985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.1:39905)
0810 21:04:50.083169 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.083214 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.083790 (+ 576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.084145 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.084149 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.084825 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.085052 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.085058 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.085884 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.085885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.086959 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.086962 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.087380 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.087381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.087540 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.088204 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:50.088213 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:50.089978 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:50.091868 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.091878 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.091880 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.092235 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.092465 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.092466 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.092466 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.092666 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.092940 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:50.092948 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:50.093143 (+ 195us) client_negotiation.cc:769] Sending connection context
0810 21:04:50.093267 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 21:04:50.093474 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":105,"threads_started":1}
I20260810 21:04:50.094347 25105 heartbeater.cc:347] Connected to a master server at 127.15.37.62:34421
I20260810 21:04:50.094476 25105 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:50.094684 25105 heartbeater.cc:511] Master 127.15.37.62:34421 requested a full tablet report, sending...
I20260810 21:04:50.095273 24823 ts_manager.cc:194] Registered new tserver with Master: 5a1a81056be146be950c9c72216433a8 (127.15.37.1:38509)
I20260810 21:04:50.096012 24823 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:39905
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab.
Entry for principal oryx/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab.
I20260810 21:04:50.113590 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:34421
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab
--principal=oryx/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:50.199160 25110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:50.199448 25110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:50.199493 25110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:50.200685 25110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:50.200762 25110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:50.200805 25110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:04:50.202346 25110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab
--principal=oryx/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:34421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:50.202648 25110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:50.202900 25110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:50.208132 25118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:50.208125 25124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:50.208128 25121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:50.208511 25110 server_base.cc:1034] running on GCE node
I20260810 21:04:50.208765 25110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:50.209043 25110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:50.210223 25110 hybrid_clock.cc:648] HybridClock initialized: now 1786395890210202 us; error 40 us; skew 500 ppm
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:50.213122 25110 init.cc:377] Logged in from keytab as oryx/127.15.37.2@KRBTEST.COM (short username oryx)
I20260810 21:04:50.213621 25110 webserver.cc:460] Webserver started at http://127.15.37.2:44013/ using document root <none> and password file <none>
I20260810 21:04:50.213824 25110 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:50.213864 25110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:50.213963 25110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:50.215032 25110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "cc606120767a40989937f0a334aff24c"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "51be6ab33306db67d00e98212436a2b0"
server_key_iv: "05fdc202e58dfcbb179ad7cfc371badf"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.215373 25110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "cc606120767a40989937f0a334aff24c"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "51be6ab33306db67d00e98212436a2b0"
server_key_iv: "05fdc202e58dfcbb179ad7cfc371badf"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.216741 25110 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:04:50.217584 25136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:50.217902 25110 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:50.218003 25110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "cc606120767a40989937f0a334aff24c"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "51be6ab33306db67d00e98212436a2b0"
server_key_iv: "05fdc202e58dfcbb179ad7cfc371badf"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.218066 25110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:50.231268 25110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:50.233479 25110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:50.233604 25110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:50.233811 25110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:50.234192 25110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:50.234229 25110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:50.234253 25110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:50.234303 25110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:50.240183 25110 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:37153
I20260810 21:04:50.240262 25307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:37153 every 8 connection(s)
I20260810 21:04:50.240659 25110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:50.249761 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 25110
I20260810 21:04:50.249871 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:04:50.250123 15508 external_mini_cluster.cc:1428] Setting key 7b944099192cf14dfa24b20b0e1c889a
I20260810 21:04:50.250263 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.241473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:43203 (local address 127.15.37.62:34421)
0810 21:04:50.241559 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.241562 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.241751 (+ 189us) server_negotiation.cc:407] Connection header received
0810 21:04:50.242268 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.242269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.242279 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.242345 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.243297 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.243814 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.244897 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.245088 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.245144 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.247338 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.247339 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.247339 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.247346 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.248855 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.249225 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.249226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.249226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.249281 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.249491 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.249491 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.249492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.249672 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.249755 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.250066 (+ 311us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.250167 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 21:04:50.250427 25311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.241456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.2:43203)
0810 21:04:50.241615 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.241659 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.242180 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.242400 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.242404 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.243014 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.243220 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.243226 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.243898 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.243899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.244822 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.244825 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.245168 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.245169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.245277 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.245776 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:50.245785 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:50.247247 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:50.248944 (+ 1697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.248949 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.248951 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.249159 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.249340 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.249340 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.249341 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.249436 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.249747 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:50.249751 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:50.249892 (+ 141us) client_negotiation.cc:769] Sending connection context
0810 21:04:50.250015 (+ 123us) client_negotiation.cc:240] Negotiation successful
0810 21:04:50.250144 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":81,"threads_started":1}
I20260810 21:04:50.251058 25308 heartbeater.cc:347] Connected to a master server at 127.15.37.62:34421
I20260810 21:04:50.251183 25308 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:50.251365 25308 heartbeater.cc:511] Master 127.15.37.62:34421 requested a full tablet report, sending...
I20260810 21:04:50.251821 24823 ts_manager.cc:194] Registered new tserver with Master: cc606120767a40989937f0a334aff24c (127.15.37.2:37153)
I20260810 21:04:50.252214 24823 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:43203
WARNING: no policy specified for oryx/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab.
Entry for principal oryx/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab.
I20260810 21:04:50.277594 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:34421
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab
--principal=oryx/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:50.363749 25316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:50.363994 25316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:50.364023 25316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:50.365264 25316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:50.365315 25316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:50.365343 25316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:04:50.366883 25316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab
--principal=oryx/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:34421
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:50.367166 25316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:50.367434 25316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:50.372997 25323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:50.373070 25316 server_base.cc:1034] running on GCE node
W20260810 21:04:50.373008 25324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:50.373186 25326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:50.373497 25316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:50.373769 25316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:50.374925 25316 hybrid_clock.cc:648] HybridClock initialized: now 1786395890374912 us; error 31 us; skew 500 ppm
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:50.377691 25316 init.cc:377] Logged in from keytab as oryx/127.15.37.3@KRBTEST.COM (short username oryx)
I20260810 21:04:50.378260 25316 webserver.cc:460] Webserver started at http://127.15.37.3:36117/ using document root <none> and password file <none>
I20260810 21:04:50.378510 25316 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:50.378582 25316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:50.378746 25316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:50.379966 25316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "4c9351d65b0b441c8a58fc399023e634"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "cc5a834a5c806eb21d8954a52b1002b7"
server_key_iv: "a92efdc5aaf18790af2b78076d11ed9e"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.380373 25316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "4c9351d65b0b441c8a58fc399023e634"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "cc5a834a5c806eb21d8954a52b1002b7"
server_key_iv: "a92efdc5aaf18790af2b78076d11ed9e"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.381867 25316 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:50.382718 25337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:50.382912 25316 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:50.383049 25316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "4c9351d65b0b441c8a58fc399023e634"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "cc5a834a5c806eb21d8954a52b1002b7"
server_key_iv: "a92efdc5aaf18790af2b78076d11ed9e"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.383134 25316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:50.392916 25316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:50.395429 25316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:50.395622 25316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:50.395881 25316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:50.396250 25316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:50.396312 25316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:50.396363 25316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:50.396385 25316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:50.402880 25316 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:40731
I20260810 21:04:50.402925 25509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:40731 every 8 connection(s)
I20260810 21:04:50.403291 25316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:04:50.403532 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 25316
I20260810 21:04:50.403656 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:04:50.403882 15508 external_mini_cluster.cc:1428] Setting key e670a96076aa449837a37e8f013a289d
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:50.412858 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.404241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:36053 (local address 127.15.37.62:34421)
0810 21:04:50.404306 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.404308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.404632 (+ 324us) server_negotiation.cc:407] Connection header received
0810 21:04:50.405155 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.405156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.405167 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.405212 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.406200 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.406714 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.407705 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.407888 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.407939 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.410233 (+ 2294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.410234 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.410235 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.410241 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.411651 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.412016 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.412017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.412017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.412070 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.412283 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.412284 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.412284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.412382 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.412428 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.412723 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.412788 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 21:04:50.413121 25514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.404167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.3:36053)
0810 21:04:50.404470 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.404548 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.405062 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.405269 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.405273 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.405885 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.406116 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.406121 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.406798 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.406799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.407629 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.407631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.407960 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.407961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.408068 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.408709 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:50.408718 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:50.410141 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:50.411726 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.411733 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.411735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.411955 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.412132 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.412133 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.412133 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.412235 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.412433 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:50.412438 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:50.412619 (+ 181us) client_negotiation.cc:769] Sending connection context
0810 21:04:50.412704 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 21:04:50.412832 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":116,"threads_started":1}
I20260810 21:04:50.413719 25511 heartbeater.cc:347] Connected to a master server at 127.15.37.62:34421
I20260810 21:04:50.413843 25511 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:50.414043 25511 heartbeater.cc:511] Master 127.15.37.62:34421 requested a full tablet report, sending...
I20260810 21:04:50.414451 24823 ts_manager.cc:194] Registered new tserver with Master: 4c9351d65b0b441c8a58fc399023e634 (127.15.37.3:40731)
I20260810 21:04:50.414839 24823 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:36053
I20260810 21:04:50.415665 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.37.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.37.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.37.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.61.keytab.
Entry for principal oryx/127.15.37.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.61.keytab.
I20260810 21:04:50.443740 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.61:36981
--webserver_interface=127.15.37.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.61.keytab
--principal=oryx/127.15.37.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:34421,127.15.37.61:36981
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:50.531097 25517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:50.531383 25517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:50.531423 25517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:50.532750 25517 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:50.532816 25517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:50.532841 25517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:50.532874 25517 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:50.532908 25517 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:50.534511 25517 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:34421,127.15.37.61:36981
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.61.keytab
--principal=oryx/127.15.37.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.61:36981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.37.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
W20260810 21:04:50.534685 25517 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.15.37.62:34421,127.15.37.61:36981'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260810 21:04:50.534852 25517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:50.535100 25517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:50.540680 25527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:50.540689 25531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:50.540721 25528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:50.540973 25517 server_base.cc:1034] running on GCE node
I20260810 21:04:50.541275 25517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:50.541613 25517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:50.542761 25517 hybrid_clock.cc:648] HybridClock initialized: now 1786395890542728 us; error 55 us; skew 500 ppm
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:50.545536 25517 init.cc:377] Logged in from keytab as oryx/127.15.37.61@KRBTEST.COM (short username oryx)
I20260810 21:04:50.546077 25517 webserver.cc:460] Webserver started at http://127.15.37.61:41593/ using document root <none> and password file <none>
I20260810 21:04:50.546324 25517 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:50.546396 25517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:50.546564 25517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:50.547703 25517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/data/instance:
uuid: "7b2a2571606b48b6b720acc0a972ec1a"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "184955be69782334c9f915c32b405f4d"
server_key_iv: "6c685dc757f65726ff9a67a15b0b4a5a"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.548110 25517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/wal/instance:
uuid: "7b2a2571606b48b6b720acc0a972ec1a"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "184955be69782334c9f915c32b405f4d"
server_key_iv: "6c685dc757f65726ff9a67a15b0b4a5a"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.549712 25517 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:04:50.550529 25541 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:50.550717 25517 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:50.550844 25517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/wal
uuid: "7b2a2571606b48b6b720acc0a972ec1a"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "184955be69782334c9f915c32b405f4d"
server_key_iv: "6c685dc757f65726ff9a67a15b0b4a5a"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.550928 25517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:50.566134 25517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:50.568751 25517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:50.568928 25517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:50.573561 25517 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.61:36981
I20260810 21:04:50.573591 25613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.61:36981 every 8 connection(s)
I20260810 21:04:50.573982 25517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/data/info.pb
I20260810 21:04:50.575155 25614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:50.577092 25614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:04:50.580247 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 25517
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.61@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.37.61@KRBTEST.COM
I20260810 21:04:50.587807 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.577902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37250 (local address 127.15.37.62:34421)
0810 21:04:50.577981 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.577984 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.578234 (+ 250us) server_negotiation.cc:407] Connection header received
0810 21:04:50.578698 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.578700 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.578712 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.578770 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.579423 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.579929 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.581412 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.581625 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.581704 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.584204 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.584206 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.584206 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.584215 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.586025 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.586601 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.586602 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.586602 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.586666 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.586988 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.586990 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.586990 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.587189 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.587252 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.587597 (+ 345us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.587694 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 21:04:50.588150 25618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.577879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37250)
0810 21:04:50.578106 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.578145 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.578607 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.578853 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.578856 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.579133 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.579341 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.579346 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.580044 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.580046 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.581299 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.581302 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.581723 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.581724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.581854 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.582436 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:50.582445 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:50.584100 (+ 1655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:50.586141 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.586149 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.586151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.586524 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.586742 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.586743 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.586743 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.586903 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.587266 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:50.587273 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:50.587453 (+ 180us) client_negotiation.cc:769] Sending connection context
0810 21:04:50.587546 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 21:04:50.587847 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":137,"threads_started":1}
I20260810 21:04:50.589046 25614 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:04:50.590371 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.580927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49184 (local address 127.15.37.61:36981)
0810 21:04:50.581153 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.581158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.581180 (+ 22us) server_negotiation.cc:407] Connection header received
0810 21:04:50.581251 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.581253 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.581287 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.581367 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.582005 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.582693 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.583764 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.584178 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.584263 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.586846 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.586852 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.586852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.586859 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.589043 (+ 2184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.589482 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.589486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.589487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.589550 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.589775 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.589776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.589776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.589939 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.590121 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.590171 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.590255 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":128,"threads_started":1}
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.61@KRBTEST.COM for oryx/127.15.37.61@KRBTEST.COM
I20260810 21:04:50.596719 25627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.589415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49198 (local address 127.15.37.61:36981)
0810 21:04:50.589628 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.589630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.589638 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:04:50.589663 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.589664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.589673 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.589754 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.590020 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.590688 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.591429 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.591630 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.591688 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.593515 (+ 1827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.593516 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.593516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.593523 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.595438 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.595806 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.595807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.595807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.595867 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.596084 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.596084 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.596085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.596199 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.596271 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.596426 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.596582 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":194,"thread_start_us":162,"threads_started":1}
I20260810 21:04:50.596784 25618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.589337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:36981 (local address 127.0.0.1:49198)
0810 21:04:50.589389 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.589400 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.589438 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.589756 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.589757 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.589896 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.589943 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.589944 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.590767 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.590768 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.591359 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.591361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.591699 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.591699 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.591758 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.592202 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:50.592207 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:50.593415 (+ 1208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:50.595551 (+ 2136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.595552 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.595552 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.595716 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.595943 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.595944 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.595944 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.596007 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.596274 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:50.596275 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:50.596313 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 21:04:50.596403 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 21:04:50.596662 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":136}
I20260810 21:04:50.598202 25614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: Bootstrap starting.
I20260810 21:04:50.598917 25614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:50.599238 25614 log.cc:824] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:50.600070 25614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: No bootstrap required, opened a new log
I20260810 21:04:50.601670 25614 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } }
I20260810 21:04:50.601810 25614 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:50.601833 25614 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b2a2571606b48b6b720acc0a972ec1a, State: Initialized, Role: FOLLOWER
I20260810 21:04:50.602016 25614 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } }
I20260810 21:04:50.602309 25629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } } }
I20260810 21:04:50.602357 25614 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:50.602407 25629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: This master's current role is: FOLLOWER
W20260810 21:04:50.604519 25646 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:04:50.604619 25646 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:04:50.606681 25517 master_runner.cc:428] Detected that this master 7b2a2571606b48b6b720acc0a972ec1a is joining an existing cluster
I20260810 21:04:50.606781 25517 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.37.61:36981
I20260810 21:04:50.615126 25627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.608139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49204 (local address 127.15.37.61:36981)
0810 21:04:50.608181 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.608183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.608193 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:04:50.608242 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.608243 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.608254 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.608324 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.608899 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.609627 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.610621 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.610895 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.610974 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.611845 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.611846 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.611846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.611852 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.613527 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.613890 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.613891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.613891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.613946 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.614193 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.614194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.614194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.614347 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.614421 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.614938 (+ 517us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.615027 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 21:04:50.615222 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.607986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37264 (local address 127.15.37.62:34421)
0810 21:04:50.608034 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.608036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.608200 (+ 164us) server_negotiation.cc:407] Connection header received
0810 21:04:50.608282 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.608283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.608294 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.608343 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.608874 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.609403 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.610195 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.610398 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.610476 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.611863 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.611864 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.611865 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.611874 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.613797 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.614374 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.614376 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.614376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.614435 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.614673 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.614674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.614674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.614798 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.614872 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.615037 (+ 165us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.615131 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 21:04:50.615496 25657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.607910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:36981 (local address 127.0.0.1:49204)
0810 21:04:50.608110 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.608123 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.608181 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.608367 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.608367 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.608716 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.608797 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.608800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.609715 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.609715 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.610535 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.610538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.610986 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.610987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.611054 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.611373 (+ 319us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:50.611378 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:50.611758 (+ 380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:50.613635 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.613636 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.613637 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.613816 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.614032 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.614033 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.614034 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.614111 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.614445 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:50.614445 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:50.614806 (+ 361us) client_negotiation.cc:769] Sending connection context
0810 21:04:50.615270 (+ 464us) client_negotiation.cc:240] Negotiation successful
0810 21:04:50.615359 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":110,"threads_started":1}
I20260810 21:04:50.615506 25654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.607914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37264)
0810 21:04:50.608139 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.608148 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.608224 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.608346 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.608346 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.608703 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.608786 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.608789 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.609497 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.609498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.610106 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.610107 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.610495 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.610496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.610567 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.611195 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:50.611199 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:50.611753 (+ 554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:50.614045 (+ 2292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.614046 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.614046 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.614296 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.614521 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.614521 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.614522 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.614600 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.614875 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:50.614876 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:50.614918 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 21:04:50.615006 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 21:04:50.615127 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"spinlock_wait_cycles":10112,"thread_start_us":113,"threads_started":1}
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395889, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.62@KRBTEST.COM for oryx/127.15.37.61@KRBTEST.COM
I20260810 21:04:50.626289 25627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.618413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49218 (local address 127.15.37.61:36981)
0810 21:04:50.618550 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.618552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.618627 (+ 75us) server_negotiation.cc:407] Connection header received
0810 21:04:50.618679 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.618680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.618690 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.618748 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.619284 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.620028 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.620886 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.621192 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.621267 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.623446 (+ 2179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.623448 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.623448 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.623456 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.624989 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.625408 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.625409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.625410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.625474 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.625688 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.625689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.625689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.625814 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.625894 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.626090 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.626180 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260810 21:04:50.626305 25659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.618359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:36981 (local address 127.0.0.1:49218)
0810 21:04:50.618514 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.618556 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.618622 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.618754 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.618757 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.619133 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.619204 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.619206 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.620109 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.620110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.620809 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.620812 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.621276 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.621277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.621343 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.621892 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:50.621897 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:50.623357 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:50.625105 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.625115 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.625118 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.625327 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.625554 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.625555 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.625555 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.625620 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.625887 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:50.625896 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:50.625959 (+ 63us) client_negotiation.cc:769] Sending connection context
0810 21:04:50.626051 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 21:04:50.626186 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":94,"threads_started":1}
I20260810 21:04:50.627118 24823 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.37.61:36981: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a"
member_type: NON_VOTER
last_known_addr {
host: "127.15.37.61"
port: 36981
}
attrs {
promote: true
}
}
dest_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5"
cas_config_opid_index: -1
I20260810 21:04:50.627533 24823 consensus_queue.cc:237] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true } }
I20260810 21:04:50.628132 25661 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 7b2a2571606b48b6b720acc0a972ec1a (127.15.37.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true } } }
I20260810 21:04:50.628465 25579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:50.629333 25661 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.37.61:36981
I20260810 21:04:50.629375 25579 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 FOLLOWER]: Refusing update from remote peer d91d286f2ad04cb6af2bbe5b590be3b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 21:04:50.629822 25517 master.cc:537] Master@127.15.37.61:36981 shutting down...
I20260810 21:04:50.629804 25663 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:50.629871 25662 sys_catalog.cc:455] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true } } }
W20260810 21:04:50.630678 24802 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260810 21:04:50.631206 25662 sys_catalog.cc:458] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:50.632876 25517 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:50.632983 25517 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:50.633038 25517 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: stopping tablet replica
I20260810 21:04:50.641053 25659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.640891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:36981 (local address 127.0.0.1:49230)
0810 21:04:50.640967 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.641014 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:36981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 21:04:50.641212 24802 consensus_peers.cc:487] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 -> Peer 7b2a2571606b48b6b720acc0a972ec1a (127.15.37.61:36981): Couldn't send request to peer 7b2a2571606b48b6b720acc0a972ec1a. Status: Network error: Client connection negotiation failed: client connection to 127.15.37.61:36981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 21:04:50.646986 25517 master.cc:552] Master@127.15.37.61:36981 shutdown complete.
I20260810 21:04:50.647071 25517 master_runner.cc:305] Clearing existing system tablet
I20260810 21:04:50.647212 25517 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:50.647277 25517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:50.648031 25517 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.002s sys 0.001s
I20260810 21:04:50.648651 25668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:50.648818 25517 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:50.648885 25517 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 21:04:50.648916 25517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/wal
uuid: "7b2a2571606b48b6b720acc0a972ec1a"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "184955be69782334c9f915c32b405f4d"
server_key_iv: "6c685dc757f65726ff9a67a15b0b4a5a"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.649782 25517 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:50.651348 25517 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 21:04:50.651465 25517 log.cc:1196] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260810 21:04:50.651696 25517 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: Deleting consensus metadata
I20260810 21:04:50.651847 25517 master_runner.cc:315] Copying system tablet from 127.15.37.62:34421
I20260810 21:04:50.652559 25517 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: tablet copy: Beginning tablet copy session from remote peer at address 127.15.37.62:34421
I20260810 21:04:50.659539 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.653129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37272 (local address 127.15.37.62:34421)
0810 21:04:50.653185 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.653188 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.653277 (+ 89us) server_negotiation.cc:407] Connection header received
0810 21:04:50.653367 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.653368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.653380 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.653451 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.653854 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.654410 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.655262 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.655481 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.655562 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.656712 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.656714 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.656714 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.656723 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.658248 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.658629 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.658631 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.658631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.658695 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.658945 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.658946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.658947 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.659102 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.659182 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.659344 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.659442 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 21:04:50.659559 25676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.653044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37272)
0810 21:04:50.653178 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.653191 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.653296 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.653477 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.653478 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.653659 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.653762 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.653764 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.654516 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.654517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.655170 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.655172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.655560 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.655561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.655640 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.656183 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:50.656188 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:50.656616 (+ 428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:50.658360 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.658361 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.658362 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.658549 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.658794 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.658795 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.658796 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.658863 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.659173 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:50.659174 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:50.659225 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 21:04:50.659315 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 21:04:50.659437 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":77,"threads_started":1}
I20260810 21:04:50.659986 24852 tablet_copy_service.cc:140] P d91d286f2ad04cb6af2bbe5b590be3b5: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7b2a2571606b48b6b720acc0a972ec1a ({username='oryx', principal='oryx/127.15.37.61@KRBTEST.COM'} at 127.0.0.1:37272)
I20260810 21:04:50.660184 24852 tablet_copy_service.cc:161] P d91d286f2ad04cb6af2bbe5b590be3b5: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7b2a2571606b48b6b720acc0a972ec1a at {username='oryx', principal='oryx/127.15.37.61@KRBTEST.COM'} at 127.0.0.1:37272: session id = 7b2a2571606b48b6b720acc0a972ec1a-00000000000000000000000000000000
I20260810 21:04:50.661085 24852 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 21:04:50.661792 25517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 21:04:50.662925 25517 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: tablet copy: Starting download of 0 data blocks...
I20260810 21:04:50.663116 25517 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: tablet copy: Starting download of 1 WAL segments...
I20260810 21:04:50.664183 25517 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 21:04:50.665191 24852 tablet_copy_service.cc:342] P d91d286f2ad04cb6af2bbe5b590be3b5: Request end of tablet copy session 7b2a2571606b48b6b720acc0a972ec1a-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.37.61@KRBTEST.COM'} at 127.0.0.1:37272
I20260810 21:04:50.665257 24852 tablet_copy_service.cc:433] P d91d286f2ad04cb6af2bbe5b590be3b5: ending tablet copy session 7b2a2571606b48b6b720acc0a972ec1a-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7b2a2571606b48b6b720acc0a972ec1a
I20260810 21:04:50.668277 25517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:50.669495 25677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:50.669551 25680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:50.669611 25678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:50.672672 25517 server_base.cc:1034] running on GCE node
I20260810 21:04:50.672799 25517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:50.672976 25517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:50.674117 25517 hybrid_clock.cc:648] HybridClock initialized: now 1786395890674098 us; error 44 us; skew 500 ppm
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:50.675591 25517 init.cc:377] Logged in from keytab as oryx/127.15.37.61@KRBTEST.COM (short username oryx)
I20260810 21:04:50.675940 25517 webserver.cc:460] Webserver started at http://127.15.37.61:43991/ using document root <none> and password file <none>
I20260810 21:04:50.676080 25517 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:50.676128 25517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:50.676860 25517 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:50.677471 25693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:50.677661 25517 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 21:04:50.677721 25517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/wal
uuid: "7b2a2571606b48b6b720acc0a972ec1a"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "184955be69782334c9f915c32b405f4d"
server_key_iv: "6c685dc757f65726ff9a67a15b0b4a5a"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.677784 25517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:50.690989 25517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:50.692958 25517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:50.696240 25517 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.61:36981
I20260810 21:04:50.696259 25770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.61:36981 every 8 connection(s)
I20260810 21:04:50.696688 25517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-1/data/info.pb
I20260810 21:04:50.697566 25773 sys_catalog.cc:263] Verifying existing consensus state
I20260810 21:04:50.698010 25773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: Bootstrap starting.
I20260810 21:04:50.700450 25773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 21:04:50.700758 25773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: Bootstrap complete.
I20260810 21:04:50.700968 25773 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true } }
I20260810 21:04:50.701059 25773 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7b2a2571606b48b6b720acc0a972ec1a, State: Initialized, Role: LEARNER
I20260810 21:04:50.701113 25773 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true } }
I20260810 21:04:50.701342 25773 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:50.701315 25777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true } } }
I20260810 21:04:50.701397 25777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: This master's current role is: LEARNER
I20260810 21:04:50.703265 25792 catalog_manager.cc:1259] Loaded cluster ID: 4d1ff3fb82c349de81f5eb1bb9ef3da7
I20260810 21:04:50.703341 25792 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: loading cluster ID for follower catalog manager: success
I20260810 21:04:50.704121 25792 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: acquiring CA information for follower catalog manager: success
I20260810 21:04:50.704403 25792 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 21:04:50.750144 25794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.742753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49264 (local address 127.15.37.61:36981)
0810 21:04:50.742886 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.742894 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.742906 (+ 12us) server_negotiation.cc:407] Connection header received
0810 21:04:50.742933 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.742934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.742943 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.743018 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.743720 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.744359 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.745462 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.745668 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.745734 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.747245 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.747246 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.747246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.747253 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.748947 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.749359 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.749360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.749360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.749424 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.749632 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.749632 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.749632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.749741 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.749814 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.749977 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.750047 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":79,"threads_started":1}
WARNING: no policy specified for oryx/127.15.37.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.37.60@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.37.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.60.keytab.
Entry for principal oryx/127.15.37.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.60.keytab.
I20260810 21:04:50.780196 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.60:43581
--webserver_interface=127.15.37.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.60.keytab
--principal=oryx/127.15.37.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:34421,127.15.37.61:36981,127.15.37.60:43581
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:50.880302 25797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:50.880621 25797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:50.880654 25797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:50.881956 25797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:50.881999 25797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:50.882014 25797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:50.882026 25797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:50.882038 25797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:50.883823 25797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:34421,127.15.37.61:36981,127.15.37.60:43581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.60.keytab
--principal=oryx/127.15.37.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.60:43581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.37.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:50.884069 25797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:50.884276 25797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:50.890998 25803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:50.890923 25808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:50.891141 25797 server_base.cc:1034] running on GCE node
W20260810 21:04:50.891067 25805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:50.891479 25797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:50.891825 25797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:50.892976 25797 hybrid_clock.cc:648] HybridClock initialized: now 1786395890892952 us; error 47 us; skew 500 ppm
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:50.895710 25797 init.cc:377] Logged in from keytab as oryx/127.15.37.60@KRBTEST.COM (short username oryx)
I20260810 21:04:50.896219 25797 webserver.cc:460] Webserver started at http://127.15.37.60:33317/ using document root <none> and password file <none>
I20260810 21:04:50.896509 25797 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:50.896636 25797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:50.896786 25797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:50.898030 25797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/data/instance:
uuid: "86a5be9470f243938e2033f6ca57747c"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "e5dadec27c034c3631e03cad94929f90"
server_key_iv: "680538356259c3f5049a2ebfa79f8c49"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.898435 25797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/wal/instance:
uuid: "86a5be9470f243938e2033f6ca57747c"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "e5dadec27c034c3631e03cad94929f90"
server_key_iv: "680538356259c3f5049a2ebfa79f8c49"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.900002 25797 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:50.900993 25819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:50.901257 25797 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 21:04:50.901363 25797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/wal
uuid: "86a5be9470f243938e2033f6ca57747c"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "e5dadec27c034c3631e03cad94929f90"
server_key_iv: "680538356259c3f5049a2ebfa79f8c49"
server_key_version: "encryptionkey@0"
I20260810 21:04:50.901448 25797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:50.911918 25797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:50.914597 25797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:50.914765 25797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:50.926477 25797 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.60:43581
I20260810 21:04:50.926859 25891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.60:43581 every 8 connection(s)
I20260810 21:04:50.927130 25797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/data/info.pb
I20260810 21:04:50.927368 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 25797
I20260810 21:04:50.929078 25893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:50.933156 25893 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.37.60@KRBTEST.COM
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.60@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:50.943097 25895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.928391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48556 (local address 127.15.37.60:43581)
0810 21:04:50.930297 (+ 1906us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.930323 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.930392 (+ 69us) server_negotiation.cc:407] Connection header received
0810 21:04:50.931122 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.931133 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.931203 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.931434 (+ 231us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.932102 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.933931 (+ 1829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.934948 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.935736 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.935822 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.939077 (+ 3255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.939084 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.939085 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.939091 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.941445 (+ 2354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.941834 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.941838 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.941839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.941933 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.942158 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.942159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.942160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.942456 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.942612 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.942685 (+ 73us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.942841 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1823,"thread_start_us":720,"threads_started":1}
I20260810 21:04:50.943991 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.934208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37286 (local address 127.15.37.62:34421)
0810 21:04:50.934260 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.934262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.934590 (+ 328us) server_negotiation.cc:407] Connection header received
0810 21:04:50.934675 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.934676 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.934688 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.934741 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.935678 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.936388 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.937351 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.937652 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.937713 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.940802 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.940804 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.940805 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.940814 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.942341 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.942762 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.942764 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.942764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.942832 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.943040 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.943041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.943042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.943207 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.943280 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.943755 (+ 475us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.943874 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 21:04:50.944013 25896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.934077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37286)
0810 21:04:50.934481 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.934515 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.934606 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.934847 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.934851 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.935319 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.935579 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.935581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.936640 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.936641 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.937250 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.937253 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.937906 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.937909 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.938106 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.938804 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:50.938815 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:50.940703 (+ 1888us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:50.942420 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.942425 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.942428 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.942673 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.942893 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.942894 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.942895 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.942970 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.943287 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:50.943291 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:50.943618 (+ 327us) client_negotiation.cc:769] Sending connection context
0810 21:04:50.943695 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 21:04:50.943835 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":290,"threads_started":1}
I20260810 21:04:50.944622 25893 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.60@KRBTEST.COM for oryx/127.15.37.61@KRBTEST.COM
I20260810 21:04:50.952196 25896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.944904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:36981 (local address 127.0.0.1:49278)
0810 21:04:50.944953 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.944963 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.944998 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.945241 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.945243 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.945405 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.945637 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.945639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.946329 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.946330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.946860 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.946861 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.947291 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.947292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.947427 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.947925 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:50.947930 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:50.949302 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:50.951198 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.951199 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.951199 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.951371 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.951567 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.951567 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.951568 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.951623 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.951940 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:50.951940 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:50.951979 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 21:04:50.952029 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 21:04:50.952122 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 21:04:50.952207 25794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.945032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49278 (local address 127.15.37.61:36981)
0810 21:04:50.945076 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.945078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.945100 (+ 22us) server_negotiation.cc:407] Connection header received
0810 21:04:50.945127 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.945128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.945142 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.945233 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.945729 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.946240 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.946959 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.947203 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.947282 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.949399 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.949401 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.949401 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.949411 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.951108 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.951443 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.951445 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.951445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.951502 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.951710 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.951712 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.951712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.951872 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.951940 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.952048 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.952141 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 21:04:50.953069 25893 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 21:04:50 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395890, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.60@KRBTEST.COM for oryx/127.15.37.60@KRBTEST.COM
I20260810 21:04:50.960294 25895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.953469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48560 (local address 127.15.37.60:43581)
0810 21:04:50.953512 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.953514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.953580 (+ 66us) server_negotiation.cc:407] Connection header received
0810 21:04:50.953623 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.953624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.953632 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.953679 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.953921 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.954547 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.955263 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.955619 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.955682 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.957612 (+ 1930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.957614 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.957615 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.957621 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.959163 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.959468 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.959469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.959469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.959522 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.959683 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.959684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.959684 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.959825 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.959903 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.960064 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.960178 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":21}
I20260810 21:04:50.960341 25896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.953465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:43581 (local address 127.0.0.1:48560)
0810 21:04:50.953522 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.953533 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.953586 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.953696 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.953697 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.953821 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.953858 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.953859 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.954622 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.954622 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.955188 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.955190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.955688 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.955689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.955732 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.956158 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:50.956162 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:50.957526 (+ 1364us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:50.959238 (+ 1712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.959239 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.959239 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.959401 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.959579 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.959580 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.959580 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.959632 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.959908 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:50.959909 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:50.959950 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 21:04:50.960039 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 21:04:50.960231 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":94}
I20260810 21:04:50.962463 25893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: Bootstrap starting.
I20260810 21:04:50.964031 25893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:50.964785 25893 log.cc:824] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:50.965767 25893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: No bootstrap required, opened a new log
I20260810 21:04:50.968664 25893 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } }
I20260810 21:04:50.968912 25893 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:50.968976 25893 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86a5be9470f243938e2033f6ca57747c, State: Initialized, Role: FOLLOWER
I20260810 21:04:50.969170 25893 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } }
I20260810 21:04:50.969702 25893 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:50.969789 25898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } } }
I20260810 21:04:50.969949 25898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: This master's current role is: FOLLOWER
W20260810 21:04:50.972935 25916 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:04:50.973016 25916 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:04:50.975569 25797 master_runner.cc:428] Detected that this master 86a5be9470f243938e2033f6ca57747c is joining an existing cluster
I20260810 21:04:50.975646 25797 master_runner.cc:432] Initiating AddMaster RPC to add 127.15.37.60:43581
I20260810 21:04:50.987735 25794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.977698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49288 (local address 127.15.37.61:36981)
0810 21:04:50.977808 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.977811 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.978488 (+ 677us) server_negotiation.cc:407] Connection header received
0810 21:04:50.978598 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.978599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.978613 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.978716 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.979657 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.980559 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.982233 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.982543 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.982586 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.984271 (+ 1685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:50.984273 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:50.984273 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:50.984282 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:50.986217 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.986728 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.986730 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.986730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.986827 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:50.987166 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:50.987167 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:50.987167 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:50.987294 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:50.987354 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:50.987543 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 21:04:50.987653 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 21:04:50.988085 25925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.977530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:36981 (local address 127.0.0.1:49288)
0810 21:04:50.978374 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.978388 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.978499 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.978740 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.978741 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.979183 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.979529 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.979532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.980652 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.980653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.982122 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.982126 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.982753 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.982754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.982862 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:50.983583 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:50.983588 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:50.984080 (+ 492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:50.986343 (+ 2263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.986344 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.986345 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.986629 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.986938 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:50.986939 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:50.986939 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:50.987087 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:50.987388 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:50.987389 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:50.987442 (+ 53us) client_negotiation.cc:769] Sending connection context
0810 21:04:50.987518 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 21:04:50.987685 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"mutex_wait_us":51,"thread_start_us":633,"threads_started":1}
I20260810 21:04:50.995239 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 24913
I20260810 21:04:51.009164 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.977919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37294 (local address 127.15.37.62:34421)
0810 21:04:50.977992 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.977994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.978773 (+ 779us) server_negotiation.cc:407] Connection header received
0810 21:04:50.979206 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.979208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.979238 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.979290 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.980062 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.980891 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.982408 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.982722 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.982775 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.005246 (+ 22471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.005249 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.005249 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.005260 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.007172 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.008155 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.008157 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.008157 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.008228 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.008443 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.008444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.008444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.008650 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.008704 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.008951 (+ 247us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.009053 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 21:04:51.009274 25895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.977897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48576 (local address 127.15.37.60:43581)
0810 21:04:50.977993 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:50.977995 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:50.979002 (+ 1007us) server_negotiation.cc:407] Connection header received
0810 21:04:50.979105 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:50.979106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:50.979118 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:50.979204 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:50.980024 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.980916 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.982512 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.982797 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.982842 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.005552 (+ 22710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.005554 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.005555 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.005562 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.007957 (+ 2395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.008386 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.008388 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.008388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.008451 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.008666 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.008666 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.008667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.008811 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.008859 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.009057 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.009155 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 21:04:51.009703 25924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.977538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37294)
0810 21:04:50.978706 (+ 1168us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.978716 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.979118 (+ 402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.979418 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.979418 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.979755 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.979945 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.979947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.981023 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.981024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.982322 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.982324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.982881 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.982881 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.983055 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.004408 (+ 21353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:51.004416 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:51.005058 (+ 642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:51.007294 (+ 2236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.007295 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.007296 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.008067 (+ 771us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.008301 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.008301 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.008301 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.008360 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.008760 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:51.008761 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:51.008809 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.009355 (+ 546us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.009531 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1131,"mutex_wait_us":130,"thread_start_us":467,"threads_started":1}
I20260810 21:04:51.009799 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:50.978379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:43581 (local address 127.0.0.1:48576)
0810 21:04:50.978898 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:50.978908 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:50.979047 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:50.979260 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:50.979261 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:50.979668 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:50.979879 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.979881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.981043 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.981043 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.982379 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:50.982383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:50.982937 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:50.982937 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:50.983058 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.004560 (+ 21502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:51.004567 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:51.005438 (+ 871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:51.008060 (+ 2622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.008062 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.008062 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.008296 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.008539 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.008540 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.008540 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.008602 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.008905 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:51.008906 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:51.008950 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.009422 (+ 472us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.009620 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":129,"thread_start_us":220,"threads_started":1}
I20260810 21:04:51.011055 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:38509
--local_ip_for_outbound_sockets=127.15.37.1
--tserver_master_addrs=127.15.37.62:34421
--webserver_port=41711
--webserver_interface=127.15.37.1
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab
--principal=oryx/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.37.62:34421,127.15.37.61:36981
--tserver_master_addrs=127.15.37.62:34421,127.15.37.61:36981,127.15.37.60:43581 with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395889, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.62@KRBTEST.COM for oryx/127.15.37.60@KRBTEST.COM
I20260810 21:04:51.022398 25659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.012547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:43581 (local address 127.0.0.1:48592)
0810 21:04:51.012595 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.012609 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.012660 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.013472 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.013473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.013683 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:51.013746 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.013748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.014719 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.014720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.015578 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.015580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.016126 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.016127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.016210 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.016793 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:51.016802 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:51.018650 (+ 1848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:51.020874 (+ 2224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.020875 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.020876 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.021168 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.021437 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.021438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.021439 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.021521 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.021926 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:51.021928 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:51.021991 (+ 63us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.022086 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.022241 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260810 21:04:51.022806 25895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.013230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48592 (local address 127.15.37.60:43581)
0810 21:04:51.013301 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.013302 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.013312 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:04:51.013350 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.013351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.013362 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.013429 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.013830 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.014615 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.015677 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.016027 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.016110 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.018760 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.018762 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.018762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.018771 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.020770 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.021264 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.021265 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.021266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.021336 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.021633 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.021634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.021635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.021816 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.021891 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.022571 (+ 680us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.022673 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 21:04:51.023581 24823 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.15.37.60:43581: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "86a5be9470f243938e2033f6ca57747c"
member_type: NON_VOTER
last_known_addr {
host: "127.15.37.60"
port: 43581
}
attrs {
promote: true
}
}
dest_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5"
cas_config_opid_index: 5
I20260810 21:04:51.023900 24823 consensus_queue.cc:237] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } }
I20260810 21:04:51.024462 25662 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 86a5be9470f243938e2033f6ca57747c (127.15.37.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } } }
I20260810 21:04:51.025250 25860 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:51.026212 25662 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.15.37.60:43581
I20260810 21:04:51.026296 25662 sys_catalog.cc:455] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } } }
I20260810 21:04:51.026363 25662 sys_catalog.cc:458] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:51.026715 25860 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 FOLLOWER]: Refusing update from remote peer d91d286f2ad04cb6af2bbe5b590be3b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 21:04:51.027070 25797 master.cc:537] Master@127.15.37.60:43581 shutting down...
I20260810 21:04:51.027014 25663 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 21:04:51.027805 24801 consensus_peers.cc:487] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 -> Peer 86a5be9470f243938e2033f6ca57747c (127.15.37.60:43581): Couldn't send request to peer 86a5be9470f243938e2033f6ca57747c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 21:04:51.031066 25797 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:51.031189 25797 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:51.031243 25797 tablet_replica.cc:330] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: stopping tablet replica
I20260810 21:04:51.033471 25659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.024658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:36981 (local address 127.0.0.1:49296)
0810 21:04:51.028972 (+ 4314us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.028985 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.029043 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.029284 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.029547 (+ 263us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.029550 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:51.029607 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.029611 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.030611 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.030612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.032155 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.032159 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.033170 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.033171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.033243 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.033274 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.033328 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.033376 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4288}
I20260810 21:04:51.033738 25794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.024767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49296 (local address 127.15.37.61:36981)
0810 21:04:51.028463 (+ 3696us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.028466 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.029099 (+ 633us) server_negotiation.cc:407] Connection header received
0810 21:04:51.029131 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.029132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.029158 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.029214 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:51.029702 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.030510 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.032268 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.032972 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.033050 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.033132 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.033626 (+ 494us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.033674 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3658}
I20260810 21:04:51.034014 25733 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 LEARNER]: Refusing update from remote peer d91d286f2ad04cb6af2bbe5b590be3b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 21:04:51.034284 25663 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 21:04:51.034955 25733 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 86a5be9470f243938e2033f6ca57747c (127.15.37.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } } }
I20260810 21:04:51.036160 25777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d91d286f2ad04cb6af2bbe5b590be3b5. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } } }
I20260810 21:04:51.036235 25777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: This master's current role is: LEARNER
I20260810 21:04:51.036267 25777 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: NON_VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: true } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } } }
I20260810 21:04:51.036304 25777 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: This master's current role is: LEARNER
I20260810 21:04:51.036600 25663 raft_consensus.cc:1050] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5: attempting to promote NON_VOTER 7b2a2571606b48b6b720acc0a972ec1a to VOTER
I20260810 21:04:51.036849 25663 consensus_queue.cc:237] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } }
I20260810 21:04:51.037389 25733 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 LEARNER]: Refusing update from remote peer d91d286f2ad04cb6af2bbe5b590be3b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 21:04:51.037391 25659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.037258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:43581 (local address 127.0.0.1:48604)
0810 21:04:51.037319 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.037360 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:43581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 21:04:51.037575 25662 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 21:04:51.037919 25659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.037813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:43581 (local address 127.0.0.1:48618)
0810 21:04:51.037866 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.037895 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:43581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 21:04:51.037992 24801 consensus_peers.cc:487] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 -> Peer 86a5be9470f243938e2033f6ca57747c (127.15.37.60:43581): Couldn't send request to peer 86a5be9470f243938e2033f6ca57747c. Status: Network error: Client connection negotiation failed: client connection to 127.15.37.60:43581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 21:04:51.038489 25661 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 7b2a2571606b48b6b720acc0a972ec1a (127.15.37.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } } }
I20260810 21:04:51.038651 25733 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 7b2a2571606b48b6b720acc0a972ec1a (127.15.37.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } } }
I20260810 21:04:51.039443 25661 sys_catalog.cc:455] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } } }
I20260810 21:04:51.039515 25661 sys_catalog.cc:458] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:51.039561 25661 sys_catalog.cc:455] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } } }
I20260810 21:04:51.039608 25661 sys_catalog.cc:458] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:51.039925 25932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } } }
I20260810 21:04:51.040035 25932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:04:51.047991 25797 master.cc:552] Master@127.15.37.60:43581 shutdown complete.
I20260810 21:04:51.048069 25797 master_runner.cc:305] Clearing existing system tablet
I20260810 21:04:51.048214 25797 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:51.048266 25797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:51.049141 25797 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260810 21:04:51.049739 25934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:51.049907 25797 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:51.050033 25797 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 21:04:51.050086 25797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/wal
uuid: "86a5be9470f243938e2033f6ca57747c"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "e5dadec27c034c3631e03cad94929f90"
server_key_iv: "680538356259c3f5049a2ebfa79f8c49"
server_key_version: "encryptionkey@0"
I20260810 21:04:51.051076 25797 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:51.052923 25797 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 21:04:51.053005 25797 log.cc:1196] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260810 21:04:51.053222 25797 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: Deleting consensus metadata
I20260810 21:04:51.053692 25797 master_runner.cc:315] Copying system tablet from 127.15.37.62:34421
I20260810 21:04:51.054435 25797 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: tablet copy: Beginning tablet copy session from remote peer at address 127.15.37.62:34421
I20260810 21:04:51.062830 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.054858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37296 (local address 127.15.37.62:34421)
0810 21:04:51.054917 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.054919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.054969 (+ 50us) server_negotiation.cc:407] Connection header received
0810 21:04:51.055042 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.055043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.055055 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.055157 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.055578 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.056386 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.057524 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.057839 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.057931 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.059660 (+ 1729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.059662 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.059662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.059671 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.061489 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.061921 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.061922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.061922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.061995 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.062227 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.062228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.062228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.062392 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.062463 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.062644 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.062733 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 21:04:51.062848 25942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.054769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37296)
0810 21:04:51.054906 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.054917 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.054980 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.055207 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.055208 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.055419 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:51.055481 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.055483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.056515 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.056516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.057419 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.057422 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.057944 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.057945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.058014 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.059090 (+ 1076us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:51.059096 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:51.059543 (+ 447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:51.061593 (+ 2050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.061594 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.061594 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.061834 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.062079 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.062080 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.062081 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.062154 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.062470 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:51.062471 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:51.062527 (+ 56us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.062603 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.062729 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":76,"threads_started":1}
I20260810 21:04:51.063614 24852 tablet_copy_service.cc:140] P d91d286f2ad04cb6af2bbe5b590be3b5: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 86a5be9470f243938e2033f6ca57747c ({username='oryx', principal='oryx/127.15.37.60@KRBTEST.COM'} at 127.0.0.1:37296)
I20260810 21:04:51.063704 24852 tablet_copy_service.cc:161] P d91d286f2ad04cb6af2bbe5b590be3b5: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 86a5be9470f243938e2033f6ca57747c at {username='oryx', principal='oryx/127.15.37.60@KRBTEST.COM'} at 127.0.0.1:37296: session id = 86a5be9470f243938e2033f6ca57747c-00000000000000000000000000000000
I20260810 21:04:51.064570 24852 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 21:04:51.065193 25797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 21:04:51.066598 25797 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: tablet copy: Starting download of 0 data blocks...
I20260810 21:04:51.066766 25797 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: tablet copy: Starting download of 1 WAL segments...
I20260810 21:04:51.067637 25797 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 21:04:51.068612 24852 tablet_copy_service.cc:342] P d91d286f2ad04cb6af2bbe5b590be3b5: Request end of tablet copy session 86a5be9470f243938e2033f6ca57747c-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.15.37.60@KRBTEST.COM'} at 127.0.0.1:37296
I20260810 21:04:51.068673 24852 tablet_copy_service.cc:433] P d91d286f2ad04cb6af2bbe5b590be3b5: ending tablet copy session 86a5be9470f243938e2033f6ca57747c-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 86a5be9470f243938e2033f6ca57747c
I20260810 21:04:51.071739 25797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:51.073395 25946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:51.073550 25948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:51.073812 25797 server_base.cc:1034] running on GCE node
W20260810 21:04:51.076653 25945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:51.076886 25797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:51.077060 25797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:51.078199 25797 hybrid_clock.cc:648] HybridClock initialized: now 1786395891078191 us; error 29 us; skew 500 ppm
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395891, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:51.079892 25797 init.cc:377] Logged in from keytab as oryx/127.15.37.60@KRBTEST.COM (short username oryx)
I20260810 21:04:51.080192 25797 webserver.cc:460] Webserver started at http://127.15.37.60:35619/ using document root <none> and password file <none>
I20260810 21:04:51.080324 25797 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:51.080367 25797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:51.081245 25797 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:51.081897 25959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:51.082075 25797 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 21:04:51.082136 25797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/wal
uuid: "86a5be9470f243938e2033f6ca57747c"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "e5dadec27c034c3631e03cad94929f90"
server_key_iv: "680538356259c3f5049a2ebfa79f8c49"
server_key_version: "encryptionkey@0"
I20260810 21:04:51.082204 25797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:51.105705 25797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:51.107750 25797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:51.111310 25797 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.60:43581
I20260810 21:04:51.111537 26030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.60:43581 every 8 connection(s)
I20260810 21:04:51.111701 25797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/master-2/data/info.pb
I20260810 21:04:51.112726 26032 sys_catalog.cc:263] Verifying existing consensus state
I20260810 21:04:51.113428 26032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: Bootstrap starting.
I20260810 21:04:51.116854 26032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 21:04:51.117110 26032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: Bootstrap complete.
I20260810 21:04:51.117360 26032 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } }
I20260810 21:04:51.117466 26032 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 86a5be9470f243938e2033f6ca57747c, State: Initialized, Role: LEARNER
I20260810 21:04:51.117512 26032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } }
I20260810 21:04:51.117759 26032 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:51.117731 26035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } } }
I20260810 21:04:51.117980 26035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: This master's current role is: LEARNER
I20260810 21:04:51.120378 26050 catalog_manager.cc:1259] Loaded cluster ID: 4d1ff3fb82c349de81f5eb1bb9ef3da7
I20260810 21:04:51.120436 26050 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: loading cluster ID for follower catalog manager: success
I20260810 21:04:51.121752 26050 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: acquiring CA information for follower catalog manager: success
I20260810 21:04:51.122129 26050 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 21:04:51.126868 25929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:51.127152 25929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:51.127200 25929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:51.128692 25929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:51.128767 25929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:51.128825 25929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:04:51.130759 25929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab
--principal=oryx/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:38509
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=41711
--tserver_master_addrs=127.15.37.62:34421,127.15.37.61:36981,127.15.37.60:43581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:51.131102 25929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:51.131369 25929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:51.137552 26057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:51.137665 26060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:51.137564 26058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:51.138063 25929 server_base.cc:1034] running on GCE node
I20260810 21:04:51.138291 25929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:51.138612 25929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:51.139808 25929 hybrid_clock.cc:648] HybridClock initialized: now 1786395891139785 us; error 46 us; skew 500 ppm
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395891, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:51.143529 25929 init.cc:377] Logged in from keytab as oryx/127.15.37.1@KRBTEST.COM (short username oryx)
I20260810 21:04:51.144104 25929 webserver.cc:460] Webserver started at http://127.15.37.1:41711/ using document root <none> and password file <none>
I20260810 21:04:51.144380 25929 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:51.144474 25929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:51.146288 25929 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:51.147058 26071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:51.147277 25929 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:51.147387 25929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "5a1a81056be146be950c9c72216433a8"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "b9bf728579e78f56c8524c8668c2a78c"
server_key_iv: "f6ce362b6a005837749e8121175f545c"
server_key_version: "encryptionkey@0"
I20260810 21:04:51.147884 25929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:51.158715 25929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:51.161628 25929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:51.161854 25929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:51.162264 25929 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:51.162755 25929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:51.162827 25929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:51.162873 25929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:51.162899 25929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:51.181250 25929 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:38509
I20260810 21:04:51.181365 26243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:38509 every 8 connection(s)
I20260810 21:04:51.181932 25929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395891, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.60@KRBTEST.COM
I20260810 21:04:51.192070 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 25929
I20260810 21:04:51.192260 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 25110
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395891, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.61@KRBTEST.COM
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395891, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:51.198607 25794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.184480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:42087 (local address 127.15.37.61:36981)
0810 21:04:51.184561 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.184563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.184958 (+ 395us) server_negotiation.cc:407] Connection header received
0810 21:04:51.185048 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.185049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.185063 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.185118 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.186396 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.187326 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.188777 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.189096 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.189168 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.194271 (+ 5103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.194274 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.194275 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.194287 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.196512 (+ 2225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.197154 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.197156 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.197157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.197232 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.197610 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.197612 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.197612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.197800 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.197894 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.198354 (+ 460us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.198479 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 21:04:51.199419 26252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.184139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:36981 (local address 127.15.37.1:42087)
0810 21:04:51.184863 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.184876 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.184970 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.185126 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.185126 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.185925 (+ 799us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:51.186326 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.186328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.187479 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.187480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.188673 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.188676 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.189252 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.189253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.189460 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.190479 (+ 1019us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:51.190485 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:51.194122 (+ 3637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:51.196634 (+ 2512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.196648 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.196651 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.197028 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.197326 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.197327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.197328 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.197521 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.197935 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:51.197946 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:51.198171 (+ 225us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.198787 (+ 616us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.199028 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"mutex_wait_us":4,"thread_start_us":117,"threads_started":1}
I20260810 21:04:51.199945 26247 heartbeater.cc:347] Connected to a master server at 127.15.37.61:36981
I20260810 21:04:51.200052 26247 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:51.200285 26247 heartbeater.cc:511] Master 127.15.37.61:36981 requested a full tablet report, sending...
I20260810 21:04:51.200918 25716 ts_manager.cc:194] Registered new tserver with Master: 5a1a81056be146be950c9c72216433a8 (127.15.37.1:38509)
I20260810 21:04:51.200968 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.183497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:52151 (local address 127.15.37.62:34421)
0810 21:04:51.183553 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.183556 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.183721 (+ 165us) server_negotiation.cc:407] Connection header received
0810 21:04:51.185105 (+ 1384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.185107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.185123 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.185178 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.186320 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.187073 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.188906 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.189205 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.189270 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.197490 (+ 8220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.197492 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.197492 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.197502 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.199450 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.200015 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.200017 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.200017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.200082 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.200292 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.200293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.200293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.200442 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.200536 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.200766 (+ 230us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.200861 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 21:04:51.201360 26250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.183348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.1:52151)
0810 21:04:51.183627 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.183637 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.184731 (+ 1094us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.185327 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.185328 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.185850 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:51.186214 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.186217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.187310 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.187311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.188824 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.188825 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.189322 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.189323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.189460 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.190490 (+ 1030us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:51.190504 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:51.197361 (+ 6857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:51.199665 (+ 2304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.199667 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.199667 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.199916 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.200156 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.200157 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.200157 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.200218 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.200586 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:51.200587 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:51.200638 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.201051 (+ 413us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.201189 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"mutex_wait_us":134,"thread_start_us":175,"threads_started":1}
I20260810 21:04:51.201915 26246 heartbeater.cc:347] Connected to a master server at 127.15.37.62:34421
I20260810 21:04:51.201961 26246 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:51.202021 26246 heartbeater.cc:511] Master 127.15.37.62:34421 requested a full tablet report, sending...
I20260810 21:04:51.202342 24823 ts_manager.cc:194] Re-registered known tserver with Master: 5a1a81056be146be950c9c72216433a8 (127.15.37.1:38509)
I20260810 21:04:51.202503 26249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.182954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:43581 (local address 127.15.37.1:52849)
0810 21:04:51.183318 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.183387 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.184718 (+ 1331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.185121 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.185126 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.185647 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:51.186043 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.186049 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.187357 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.187358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.188802 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.188806 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.189253 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.189255 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.189459 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.190179 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:51.190191 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:51.193674 (+ 3483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:51.200233 (+ 6559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.200235 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.200235 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.200602 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.200883 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.200884 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.200884 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.200948 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.201867 (+ 919us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:51.201868 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:51.202023 (+ 155us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.202152 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.202285 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":119,"thread_start_us":185,"threads_started":1}
I20260810 21:04:51.202864 24823 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:52151
I20260810 21:04:51.203164 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:37153
--local_ip_for_outbound_sockets=127.15.37.2
--tserver_master_addrs=127.15.37.62:34421
--webserver_port=44013
--webserver_interface=127.15.37.2
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab
--principal=oryx/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.37.62:34421,127.15.37.61:36981
--tserver_master_addrs=127.15.37.62:34421,127.15.37.61:36981,127.15.37.60:43581 with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:04:51.203368 26248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.182970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:52849 (local address 127.15.37.60:43581)
0810 21:04:51.183151 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.183153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.183506 (+ 353us) server_negotiation.cc:407] Connection header received
0810 21:04:51.184868 (+ 1362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.184870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.184891 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.185023 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.186149 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.187276 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.188928 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.189159 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.189243 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.197171 (+ 7928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.197173 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.197173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.197184 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.199874 (+ 2690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.200703 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.200705 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.200705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.200778 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.201302 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.201303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.201303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.201469 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.201525 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.202206 (+ 681us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.203300 (+ 1094us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":84,"threads_started":1}
I20260810 21:04:51.203835 26245 heartbeater.cc:347] Connected to a master server at 127.15.37.60:43581
I20260810 21:04:51.203879 26245 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:51.203944 26245 heartbeater.cc:511] Master 127.15.37.60:43581 requested a full tablet report, sending...
I20260810 21:04:51.204337 25985 ts_manager.cc:194] Registered new tserver with Master: 5a1a81056be146be950c9c72216433a8 (127.15.37.1:38509)
W20260810 21:04:51.295017 26253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:51.295248 26253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:51.295274 26253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:51.296551 26253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:51.296602 26253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:51.296633 26253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:04:51.298262 26253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab
--principal=oryx/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:37153
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=44013
--tserver_master_addrs=127.15.37.62:34421,127.15.37.61:36981,127.15.37.60:43581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:51.298547 26253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:51.298825 26253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:51.305047 26267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:51.305137 26269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:51.305130 26277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:51.305465 26253 server_base.cc:1034] running on GCE node
I20260810 21:04:51.305711 26253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:51.305986 26253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:51.307196 26253 hybrid_clock.cc:648] HybridClock initialized: now 1786395891307161 us; error 33 us; skew 500 ppm
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395891, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:51.310801 26253 init.cc:377] Logged in from keytab as oryx/127.15.37.2@KRBTEST.COM (short username oryx)
I20260810 21:04:51.311405 26253 webserver.cc:460] Webserver started at http://127.15.37.2:44013/ using document root <none> and password file <none>
I20260810 21:04:51.311657 26253 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:51.311741 26253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:51.313603 26253 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:51.314392 26294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:51.314589 26253 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:51.314738 26253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "cc606120767a40989937f0a334aff24c"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "51be6ab33306db67d00e98212436a2b0"
server_key_iv: "05fdc202e58dfcbb179ad7cfc371badf"
server_key_version: "encryptionkey@0"
I20260810 21:04:51.315301 26253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:51.329697 26253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:51.332324 26253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:51.332587 26253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:51.332876 26253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:51.333294 26253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:51.333348 26253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:51.333385 26253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:51.333408 26253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:51.347263 26253 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:37153
I20260810 21:04:51.347316 26481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:37153 every 8 connection(s)
I20260810 21:04:51.347752 26253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:04:51.350495 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 26253
I20260810 21:04:51.350692 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 25316
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395891, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.61@KRBTEST.COM
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395891, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.60@KRBTEST.COM
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395891, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:51.376721 25794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.349263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:36483 (local address 127.15.37.61:36981)
0810 21:04:51.349332 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.349334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.361873 (+ 12539us) server_negotiation.cc:407] Connection header received
0810 21:04:51.362812 (+ 939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.362825 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.362840 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.362875 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.363462 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.364268 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.365987 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.366403 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.366461 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.371521 (+ 5060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.371522 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.371523 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.371532 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.374885 (+ 3353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.375488 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.375490 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.375490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.375545 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.375806 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.375807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.375807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.375961 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.376018 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.376438 (+ 420us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.376562 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 21:04:51.377687 26491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.349196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:36981 (local address 127.15.37.2:36483)
0810 21:04:51.361789 (+ 12593us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.361800 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.362697 (+ 897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.362947 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.362947 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.363105 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:51.363330 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.363339 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.364444 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.364445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.365853 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.365857 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.366588 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.366589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.366789 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.369284 (+ 2495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:51.369296 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:51.371403 (+ 2107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:51.375041 (+ 3638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.375055 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.375058 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.375409 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.375603 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.375604 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.375604 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.375736 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.376053 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:51.376062 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:51.376258 (+ 196us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.377120 (+ 862us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.377357 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12567,"thread_start_us":71,"threads_started":1}
I20260810 21:04:51.378502 26485 heartbeater.cc:347] Connected to a master server at 127.15.37.61:36981
I20260810 21:04:51.378618 26485 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:51.378832 26485 heartbeater.cc:511] Master 127.15.37.61:36981 requested a full tablet report, sending...
I20260810 21:04:51.382196 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.349308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:51573 (local address 127.15.37.62:34421)
0810 21:04:51.349359 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.349360 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.361681 (+ 12321us) server_negotiation.cc:407] Connection header received
0810 21:04:51.361993 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.361994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.362009 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.362041 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.363462 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.364268 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.371457 (+ 7189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.371894 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.371989 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.376295 (+ 4306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.376298 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.376298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.376307 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.380765 (+ 4458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.381225 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.381226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.381227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.381294 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.381514 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.381515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.381515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.381673 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.381726 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.381938 (+ 212us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.382044 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 21:04:51.382675 26489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.348829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.2:51573)
0810 21:04:51.361312 (+ 12483us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.361345 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.361894 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.362284 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.362289 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.362890 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:51.363331 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.363339 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.364535 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.364536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.371325 (+ 6789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.371329 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.372006 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.372008 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.372113 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.373000 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:51.373006 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:51.376180 (+ 3174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:51.380881 (+ 4701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.380883 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.380883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.381135 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.381377 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.381377 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.381378 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.381445 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.381760 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:51.381760 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:51.381811 (+ 51us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.382348 (+ 537us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.382497 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12434,"mutex_wait_us":5741,"thread_start_us":103,"threads_started":1}
I20260810 21:04:51.383123 26248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.349245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:34583 (local address 127.15.37.60:43581)
0810 21:04:51.349299 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.349301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.349731 (+ 430us) server_negotiation.cc:407] Connection header received
0810 21:04:51.361970 (+ 12239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.361973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.361995 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.362033 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.363519 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.368161 (+ 4642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.369552 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.369989 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.370085 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.375313 (+ 5228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.375316 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.375316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.375327 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.381319 (+ 5992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.382035 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.382037 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.382037 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.382114 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.382334 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.382334 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.382335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.382531 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.382608 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.382834 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.382950 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 21:04:51.383260 26484 heartbeater.cc:347] Connected to a master server at 127.15.37.62:34421
I20260810 21:04:51.383328 26484 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:51.383416 26484 heartbeater.cc:511] Master 127.15.37.62:34421 requested a full tablet report, sending...
I20260810 21:04:51.383665 24823 ts_manager.cc:194] Re-registered known tserver with Master: cc606120767a40989937f0a334aff24c (127.15.37.2:37153)
I20260810 21:04:51.384024 26490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.348830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:43581 (local address 127.15.37.2:34583)
0810 21:04:51.349416 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.349471 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.361797 (+ 12326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.362284 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.362289 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.362955 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:51.363344 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.363349 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.368266 (+ 4917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.368267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.369102 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.369104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.370166 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.370168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.370374 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.372353 (+ 1979us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:51.372359 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:51.375164 (+ 2805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:51.381599 (+ 6435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.381601 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.381601 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.381881 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.382195 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.382196 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.382196 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.382258 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.382660 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:51.382661 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:51.382713 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.383252 (+ 539us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.383384 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":197,"threads_started":1}
I20260810 21:04:51.384181 24823 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:51573
I20260810 21:04:51.384413 26482 heartbeater.cc:347] Connected to a master server at 127.15.37.60:43581
I20260810 21:04:51.384465 26482 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:51.384585 26482 heartbeater.cc:511] Master 127.15.37.60:43581 requested a full tablet report, sending...
I20260810 21:04:51.384910 25985 ts_manager.cc:194] Registered new tserver with Master: cc606120767a40989937f0a334aff24c (127.15.37.2:37153)
I20260810 21:04:51.385449 25716 ts_manager.cc:194] Registered new tserver with Master: cc606120767a40989937f0a334aff24c (127.15.37.2:37153)
I20260810 21:04:51.386883 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:40731
--local_ip_for_outbound_sockets=127.15.37.3
--tserver_master_addrs=127.15.37.62:34421
--webserver_port=36117
--webserver_interface=127.15.37.3
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab
--principal=oryx/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.15.37.62:34421,127.15.37.61:36981
--tserver_master_addrs=127.15.37.62:34421,127.15.37.61:36981,127.15.37.60:43581 with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:51.478641 26492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:51.478909 26492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:51.478958 26492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:51.480144 26492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:51.480186 26492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:51.480213 26492 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:04:51.481820 26492 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab
--principal=oryx/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:40731
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=36117
--tserver_master_addrs=127.15.37.62:34421,127.15.37.61:36981,127.15.37.60:43581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:51.482046 26492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:51.482298 26492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 21:04:51.488355 26492 server_base.cc:1034] running on GCE node
W20260810 21:04:51.488314 26501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:51.488312 26505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:51.488320 26500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:51.488933 26492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:51.489228 26492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:51.490392 26492 hybrid_clock.cc:648] HybridClock initialized: now 1786395891490380 us; error 30 us; skew 500 ppm
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395891, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:51.493289 26492 init.cc:377] Logged in from keytab as oryx/127.15.37.3@KRBTEST.COM (short username oryx)
I20260810 21:04:51.493780 26492 webserver.cc:460] Webserver started at http://127.15.37.3:36117/ using document root <none> and password file <none>
I20260810 21:04:51.494029 26492 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:51.494120 26492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:51.495594 26492 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 21:04:51.496232 26517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:51.496434 26492 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:51.496577 26492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "4c9351d65b0b441c8a58fc399023e634"
format_stamp: "Formatted at 2026-08-10 21:04:50 on dist-test-slave-jq4t"
server_key: "cc5a834a5c806eb21d8954a52b1002b7"
server_key_iv: "a92efdc5aaf18790af2b78076d11ed9e"
server_key_version: "encryptionkey@0"
I20260810 21:04:51.496959 26492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:51.515084 26492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:51.517674 26492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:51.517894 26492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:51.518195 26492 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:04:51.518599 26492 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:51.518658 26492 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:51.518703 26492 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:51.518730 26492 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:51.525651 26492 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:40731
I20260810 21:04:51.525734 26695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:40731 every 8 connection(s)
I20260810 21:04:51.526149 26492 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:04:51.534495 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 26492
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395891, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.61@KRBTEST.COM
I20260810 21:04:51.535422 25659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.530316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:43581 (local address 127.0.0.1:48620)
0810 21:04:51.530420 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.530432 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.530497 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.532176 (+ 1679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.532177 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.532179 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:51.532230 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.532232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.533070 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.533072 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.534264 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.534270 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.535157 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.535159 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.535241 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.535245 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.535283 (+ 38us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.535338 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395891, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:51.536154 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.530585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48620 (local address 127.15.37.60:43581)
0810 21:04:51.530731 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.530733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.530740 (+ 7us) server_negotiation.cc:407] Connection header received
0810 21:04:51.530765 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.530766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.530794 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.532326 (+ 1532us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:51.532365 (+ 39us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.533002 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.534378 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.535040 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.535641 (+ 601us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.535745 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.535768 (+ 23us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.536051 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":75,"threads_started":1}
I20260810 21:04:51.536463 25999 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260810 21:04:51.536759 26035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d91d286f2ad04cb6af2bbe5b590be3b5. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } } }
I20260810 21:04:51.536906 26035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: This master's current role is: LEARNER
Aug 10 21:04:51 dist-test-slave-jq4t krb5kdc[24762](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395891, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.60@KRBTEST.COM
I20260810 21:04:51.540917 26248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.527173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:41669 (local address 127.15.37.60:43581)
0810 21:04:51.527277 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.527279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.527540 (+ 261us) server_negotiation.cc:407] Connection header received
0810 21:04:51.528193 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.528195 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.528210 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.528242 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.529359 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.530148 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.531819 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.532222 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.532266 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.537471 (+ 5205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.537472 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.537472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.537480 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.539233 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.539634 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.539635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.539635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.539695 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.540251 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.540252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.540252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.540391 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.540434 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.540696 (+ 262us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.540792 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260810 21:04:51.541059 26704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.527266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.3:43169)
0810 21:04:51.527477 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.527489 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.528072 (+ 583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.528802 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.528803 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.529057 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:51.529232 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.529239 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.530256 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.530257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.531667 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.531671 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.532267 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.532268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.532432 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.533410 (+ 978us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:51.533416 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:51.536054 (+ 2638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:51.539039 (+ 2985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.539050 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.539053 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.539418 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.539666 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.539667 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.539667 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.539821 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.540175 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:51.540183 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:51.540374 (+ 191us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.540556 (+ 182us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.540766 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":32,"thread_start_us":114,"threads_started":1}
I20260810 21:04:51.541277 26703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.527093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:43581 (local address 127.15.37.3:41669)
0810 21:04:51.527390 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.527447 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.528054 (+ 607us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.528385 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.528386 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.528945 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:51.529233 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.529239 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.530256 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.530257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.531689 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.531691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.532339 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.532339 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.532431 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.533292 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:51.533297 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:51.537348 (+ 4051us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:51.539327 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.539328 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.539329 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.539550 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.539773 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.539774 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.539774 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.539834 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.540529 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:51.540530 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:51.540576 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.541053 (+ 477us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.541170 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":50,"thread_start_us":91,"threads_started":1}
I20260810 21:04:51.541538 24877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.527388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:43169 (local address 127.15.37.62:34421)
0810 21:04:51.527459 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.527461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.527553 (+ 92us) server_negotiation.cc:407] Connection header received
0810 21:04:51.528195 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.528197 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.528213 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.528279 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.529362 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.530158 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.531788 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.532119 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.532165 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.536424 (+ 4259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.536426 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.536427 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.536437 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.538928 (+ 2491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.539514 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.539516 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.539516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.539584 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.539902 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.539903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.539904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.540073 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.540143 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.541355 (+ 1212us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.541448 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 21:04:51.542097 26697 heartbeater.cc:347] Connected to a master server at 127.15.37.62:34421
I20260810 21:04:51.542179 25794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.527109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:33147 (local address 127.15.37.61:36981)
0810 21:04:51.527235 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.527237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.527534 (+ 297us) server_negotiation.cc:407] Connection header received
0810 21:04:51.528257 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.528258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.528271 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.528322 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.529347 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.529969 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.531798 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.532115 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.532165 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.538171 (+ 6006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.538173 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.538173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.538182 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.540169 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.540606 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.540608 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.540608 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.540669 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.540877 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.540877 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.540878 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.540999 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.541048 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.541973 (+ 925us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.542063 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260810 21:04:51.542219 26697 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:51.542322 26707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.527093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:36981 (local address 127.15.37.3:33147)
0810 21:04:51.527410 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.527439 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.528054 (+ 615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.528368 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.528373 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.528933 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:51.529232 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.529238 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.530091 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.530092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.531673 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.531677 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.532301 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.532301 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.532442 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.533222 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:51.533254 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:51.537612 (+ 4358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:51.540252 (+ 2640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.540253 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.540253 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.540520 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.540745 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:51.540747 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:51.540747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:51.540802 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:51.541777 (+ 975us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:51.541777 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:51.541825 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.541897 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.542010 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":120,"spinlock_wait_cycles":9472,"thread_start_us":117,"threads_started":1}
I20260810 21:04:51.542378 26696 heartbeater.cc:347] Connected to a master server at 127.15.37.60:43581
I20260810 21:04:51.542459 26697 heartbeater.cc:511] Master 127.15.37.62:34421 requested a full tablet report, sending...
I20260810 21:04:51.542497 26696 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:51.542589 26696 heartbeater.cc:511] Master 127.15.37.60:43581 requested a full tablet report, sending...
I20260810 21:04:51.542796 26700 heartbeater.cc:347] Connected to a master server at 127.15.37.61:36981
I20260810 21:04:51.542865 26700 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:51.542943 26700 heartbeater.cc:511] Master 127.15.37.61:36981 requested a full tablet report, sending...
I20260810 21:04:51.542937 25985 ts_manager.cc:194] Registered new tserver with Master: 4c9351d65b0b441c8a58fc399023e634 (127.15.37.3:40731)
I20260810 21:04:51.543076 24823 ts_manager.cc:194] Re-registered known tserver with Master: 4c9351d65b0b441c8a58fc399023e634 (127.15.37.3:40731)
I20260810 21:04:51.543476 24823 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:43169
I20260810 21:04:51.543831 25716 ts_manager.cc:194] Registered new tserver with Master: 4c9351d65b0b441c8a58fc399023e634 (127.15.37.3:40731)
I20260810 21:04:51.549835 26734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.536657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49298 (local address 127.15.37.61:36981)
0810 21:04:51.537231 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.537234 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.537877 (+ 643us) server_negotiation.cc:407] Connection header received
0810 21:04:51.537901 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.537907 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.537920 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.538026 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.538890 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.539682 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.541084 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.542852 (+ 1768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.542915 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.546367 (+ 3452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.546368 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.546368 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.546376 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.548192 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.548794 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.548795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.548795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.548871 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.549100 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.549101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.549101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.549227 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.549339 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.549591 (+ 252us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.549710 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":176,"threads_started":1}
I20260810 21:04:51.550414 26729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.535888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37308 (local address 127.15.37.62:34421)
0810 21:04:51.537277 (+ 1389us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.537279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.540906 (+ 3627us) server_negotiation.cc:407] Connection header received
0810 21:04:51.540932 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.540933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.540962 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.541033 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.543312 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.543956 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.544731 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.544934 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.545028 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.546272 (+ 1244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.546273 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.546274 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.546281 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.548142 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.548756 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.548757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.548757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.548830 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.549051 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.549052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.549052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.549209 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.549393 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.550198 (+ 805us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.550307 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1364,"thread_start_us":102,"threads_started":1}
I20260810 21:04:51.553148 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.536180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48624 (local address 127.15.37.60:43581)
0810 21:04:51.537222 (+ 1042us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.537224 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.545072 (+ 7848us) server_negotiation.cc:407] Connection header received
0810 21:04:51.545192 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.545194 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.545210 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.545276 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.546162 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.546883 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.547860 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.548191 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.548267 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.550095 (+ 1828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.550097 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.550097 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.550105 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.551991 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.552398 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.552400 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.552400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.552466 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.552672 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.552673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.552673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.552806 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.552907 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.552972 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.553059 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1026,"thread_start_us":71,"threads_started":1}
I20260810 21:04:51.552287 24823 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37308:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:51.554474 24823 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:51.555346 25661 sys_catalog.cc:455] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: NON_VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: true } } }
I20260810 21:04:51.555477 25661 sys_catalog.cc:458] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:51.557116 25661 raft_consensus.cc:1050] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5: attempting to promote NON_VOTER 86a5be9470f243938e2033f6ca57747c to VOTER
I20260810 21:04:51.557243 25661 consensus_queue.cc:237] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } }
I20260810 21:04:51.557858 25999 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 LEARNER]: Refusing update from remote peer d91d286f2ad04cb6af2bbe5b590be3b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 21:04:51.558003 25733 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 FOLLOWER]: Refusing update from remote peer d91d286f2ad04cb6af2bbe5b590be3b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260810 21:04:51.558116 26746 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 21:04:51.558247 26736 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260810 21:04:51.559015 26737 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 86a5be9470f243938e2033f6ca57747c (127.15.37.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } } }
I20260810 21:04:51.559209 25999 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 86a5be9470f243938e2033f6ca57747c (127.15.37.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } } }
I20260810 21:04:51.560122 26737 sys_catalog.cc:455] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } } }
I20260810 21:04:51.560228 26737 sys_catalog.cc:458] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:51.560349 26737 sys_catalog.cc:455] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } } }
I20260810 21:04:51.560407 26737 sys_catalog.cc:458] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:51.560464 25661 sys_catalog.cc:455] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } } }
I20260810 21:04:51.560570 25661 sys_catalog.cc:458] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:51.560526 25733 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 86a5be9470f243938e2033f6ca57747c (127.15.37.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } } }
I20260810 21:04:51.560629 26035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } } }
I20260810 21:04:51.560716 26035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:04:51.562170 26756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } } }
I20260810 21:04:51.562279 26756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:04:51.565570 26749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.560957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:37153 (local address 127.0.0.1:45944)
0810 21:04:51.561773 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.561783 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.561830 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.562136 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.562137 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.562139 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:51.562248 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.562250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.563525 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.563526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.564616 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.564619 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.565308 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.565309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.565370 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.565375 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.565436 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.565485 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":799,"thread_start_us":101,"threads_started":1}
I20260810 21:04:51.565582 26751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.561303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45944 (local address 127.15.37.2:37153)
0810 21:04:51.561502 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.561506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.561907 (+ 401us) server_negotiation.cc:407] Connection header received
0810 21:04:51.561955 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.561958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.561976 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.562057 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:51.562337 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.563436 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.564704 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.565212 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.565308 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.565394 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.565461 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.565503 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":111,"threads_started":1}
I20260810 21:04:51.565680 25659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.560947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:40731 (local address 127.0.0.1:55350)
0810 21:04:51.561641 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.561652 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.561699 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.561907 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.561908 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.561910 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:51.561971 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.561974 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.563115 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.563116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.564327 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.564330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.565453 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.565454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.565520 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.565524 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.565555 (+ 31us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.565598 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"thread_start_us":108,"threads_started":1}
I20260810 21:04:51.565964 26748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.560867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:38509 (local address 127.0.0.1:46662)
0810 21:04:51.561171 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.561183 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.561564 (+ 381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.562591 (+ 1027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.562592 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.562594 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:51.562644 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.562646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.563825 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.563826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.564688 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.564690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.565721 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.565722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.565781 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.565785 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.565826 (+ 41us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.565889 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":3}
I20260810 21:04:51.566165 26750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.561209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55350 (local address 127.15.37.3:40731)
0810 21:04:51.561371 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.561377 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.561707 (+ 330us) server_negotiation.cc:407] Connection header received
0810 21:04:51.561772 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.561774 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.561790 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.561899 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:51.562057 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.563031 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.564583 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.565320 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.565758 (+ 438us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.565852 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.566023 (+ 171us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.566082 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
I20260810 21:04:51.566288 26758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.561816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46662 (local address 127.15.37.1:38509)
0810 21:04:51.562423 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.562428 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.562438 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:04:51.562475 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.562477 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.562492 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.562576 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:51.562713 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.563731 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.564785 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.565507 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.565579 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.566112 (+ 533us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.566143 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.566195 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":110,"threads_started":1}
I20260810 21:04:51.566648 26381 tablet_service.cc:1467] Processing CreateTablet for tablet f14c8c119236409f80aaaae1d37d4d25 (DEFAULT_TABLE table=test-table [id=ed9111c6f7b542849ff563f0f6f139ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:51.566818 26145 tablet_service.cc:1467] Processing CreateTablet for tablet f14c8c119236409f80aaaae1d37d4d25 (DEFAULT_TABLE table=test-table [id=ed9111c6f7b542849ff563f0f6f139ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:51.566819 26595 tablet_service.cc:1467] Processing CreateTablet for tablet f14c8c119236409f80aaaae1d37d4d25 (DEFAULT_TABLE table=test-table [id=ed9111c6f7b542849ff563f0f6f139ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:51.567099 26381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f14c8c119236409f80aaaae1d37d4d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:51.567157 26595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f14c8c119236409f80aaaae1d37d4d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:51.567157 26145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f14c8c119236409f80aaaae1d37d4d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:51.570080 26759 tablet_bootstrap.cc:492] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c: Bootstrap starting.
I20260810 21:04:51.571105 26763 tablet_bootstrap.cc:492] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8: Bootstrap starting.
I20260810 21:04:51.571295 26759 tablet_bootstrap.cc:654] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:51.571393 26764 tablet_bootstrap.cc:492] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634: Bootstrap starting.
I20260810 21:04:51.572052 26764 tablet_bootstrap.cc:654] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:51.572105 26759 log.cc:824] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:51.572221 26763 tablet_bootstrap.cc:654] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:51.573058 26764 log.cc:824] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:51.573149 26763 log.cc:824] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:51.573659 26759 tablet_bootstrap.cc:492] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c: No bootstrap required, opened a new log
I20260810 21:04:51.573750 26759 ts_tablet_manager.cc:1397] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 21:04:51.574096 26764 tablet_bootstrap.cc:492] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634: No bootstrap required, opened a new log
I20260810 21:04:51.574188 26764 ts_tablet_manager.cc:1397] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 21:04:51.576785 26759 raft_consensus.cc:348] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } }
I20260810 21:04:51.577011 26759 raft_consensus.cc:374] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:51.577061 26759 raft_consensus.cc:729] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc606120767a40989937f0a334aff24c, State: Initialized, Role: FOLLOWER
I20260810 21:04:51.577222 26759 consensus_queue.cc:260] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } }
I20260810 21:04:51.577538 26763 tablet_bootstrap.cc:492] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8: No bootstrap required, opened a new log
I20260810 21:04:51.577612 26763 ts_tablet_manager.cc:1397] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260810 21:04:51.577732 26484 heartbeater.cc:503] Master 127.15.37.62:34421 was elected leader, sending a full tablet report...
I20260810 21:04:51.577788 26764 raft_consensus.cc:348] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } }
I20260810 21:04:51.577940 26764 raft_consensus.cc:374] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:51.577978 26764 raft_consensus.cc:729] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9351d65b0b441c8a58fc399023e634, State: Initialized, Role: FOLLOWER
I20260810 21:04:51.578090 26764 consensus_queue.cc:260] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } }
I20260810 21:04:51.578435 26764 ts_tablet_manager.cc:1428] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260810 21:04:51.578588 26697 heartbeater.cc:503] Master 127.15.37.62:34421 was elected leader, sending a full tablet report...
I20260810 21:04:51.579349 26759 ts_tablet_manager.cc:1428] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c: Time spent starting tablet: real 0.006s user 0.001s sys 0.003s
I20260810 21:04:51.583259 26763 raft_consensus.cc:348] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } }
I20260810 21:04:51.583452 26763 raft_consensus.cc:374] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:51.583501 26763 raft_consensus.cc:729] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a1a81056be146be950c9c72216433a8, State: Initialized, Role: FOLLOWER
I20260810 21:04:51.583627 26763 consensus_queue.cc:260] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } }
I20260810 21:04:51.584029 26763 ts_tablet_manager.cc:1428] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8: Time spent starting tablet: real 0.006s user 0.000s sys 0.005s
I20260810 21:04:51.584161 26246 heartbeater.cc:503] Master 127.15.37.62:34421 was elected leader, sending a full tablet report...
W20260810 21:04:51.599733 26488 tablet.cc:2369] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:04:51.674290 26772 raft_consensus.cc:482] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:51.674460 26772 raft_consensus.cc:504] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } }
I20260810 21:04:51.675005 26772 leader_election.cc:288] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc606120767a40989937f0a334aff24c (127.15.37.2:37153), 4c9351d65b0b441c8a58fc399023e634 (127.15.37.3:40731)
I20260810 21:04:51.679386 26751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.675294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:42123 (local address 127.15.37.2:37153)
0810 21:04:51.675423 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.675425 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.675438 (+ 13us) server_negotiation.cc:407] Connection header received
0810 21:04:51.675475 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.675476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.675492 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.675570 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:51.675824 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.676756 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.678296 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.678954 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.679040 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.679055 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.679263 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.679309 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 21:04:51.679386 26249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.675228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:37153 (local address 127.15.37.1:42123)
0810 21:04:51.675299 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.675312 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.675360 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.675599 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.675600 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.675603 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:51.675743 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.675745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.676846 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.676847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.678159 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.678163 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.679041 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.679042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.679187 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.679192 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.679252 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.679302 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":3}
I20260810 21:04:51.679581 26250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.675232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:40731 (local address 127.15.37.1:48811)
0810 21:04:51.675549 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:51.675559 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:51.675606 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:51.675746 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:51.675747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:51.675748 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:51.675919 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.675921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.676846 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.676847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.678159 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:51.678163 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.679113 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.679114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:51.679318 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.679322 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:51.679380 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 21:04:51.679443 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":299}
I20260810 21:04:51.679885 26750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.675436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:48811 (local address 127.15.37.3:40731)
0810 21:04:51.675541 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.675544 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.675627 (+ 83us) server_negotiation.cc:407] Connection header received
0810 21:04:51.675657 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.675658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.675671 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.675720 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:51.676005 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.676753 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.678297 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.679009 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.679072 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.679083 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.679776 (+ 693us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.679835 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 21:04:51.680035 26411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f14c8c119236409f80aaaae1d37d4d25" candidate_uuid: "5a1a81056be146be950c9c72216433a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc606120767a40989937f0a334aff24c" is_pre_election: true
I20260810 21:04:51.680243 26411 raft_consensus.cc:2454] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a1a81056be146be950c9c72216433a8 in term 0.
I20260810 21:04:51.680282 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f14c8c119236409f80aaaae1d37d4d25" candidate_uuid: "5a1a81056be146be950c9c72216433a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9351d65b0b441c8a58fc399023e634" is_pre_election: true
I20260810 21:04:51.680446 26622 raft_consensus.cc:2454] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a1a81056be146be950c9c72216433a8 in term 0.
I20260810 21:04:51.680616 26074 leader_election.cc:302] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a1a81056be146be950c9c72216433a8, cc606120767a40989937f0a334aff24c; no voters:
I20260810 21:04:51.680822 26772 raft_consensus.cc:2781] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:51.680889 26772 raft_consensus.cc:482] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:51.680915 26772 raft_consensus.cc:3037] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:51.682152 26772 raft_consensus.cc:504] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } }
I20260810 21:04:51.682394 26772 leader_election.cc:288] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [CANDIDATE]: Term 1 election: Requested vote from peers cc606120767a40989937f0a334aff24c (127.15.37.2:37153), 4c9351d65b0b441c8a58fc399023e634 (127.15.37.3:40731)
I20260810 21:04:51.682600 26411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f14c8c119236409f80aaaae1d37d4d25" candidate_uuid: "5a1a81056be146be950c9c72216433a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc606120767a40989937f0a334aff24c"
I20260810 21:04:51.682598 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f14c8c119236409f80aaaae1d37d4d25" candidate_uuid: "5a1a81056be146be950c9c72216433a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9351d65b0b441c8a58fc399023e634"
I20260810 21:04:51.682690 26411 raft_consensus.cc:3037] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:51.682690 26622 raft_consensus.cc:3037] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:51.684293 26411 raft_consensus.cc:2454] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a1a81056be146be950c9c72216433a8 in term 1.
I20260810 21:04:51.684293 26622 raft_consensus.cc:2454] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a1a81056be146be950c9c72216433a8 in term 1.
I20260810 21:04:51.684520 26074 leader_election.cc:302] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5a1a81056be146be950c9c72216433a8, cc606120767a40989937f0a334aff24c; no voters:
I20260810 21:04:51.684625 26772 raft_consensus.cc:2781] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 21:04:51.684630 26251 tablet.cc:2369] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:04:51.684785 26772 raft_consensus.cc:686] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [term 1 LEADER]: Becoming Leader. State: Replica: 5a1a81056be146be950c9c72216433a8, State: Running, Role: LEADER
I20260810 21:04:51.685026 26772 consensus_queue.cc:237] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } }
I20260810 21:04:51.686108 24823 catalog_manager.cc:5495] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a1a81056be146be950c9c72216433a8 (127.15.37.1). New cstate: current_term: 1 leader_uuid: "5a1a81056be146be950c9c72216433a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } health_report { overall_health: UNKNOWN } } }
I20260810 21:04:51.713716 26758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.710908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46670 (local address 127.15.37.1:38509)
0810 21:04:51.710985 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.710987 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.711006 (+ 19us) server_negotiation.cc:407] Connection header received
0810 21:04:51.711063 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.711064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.711086 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.711162 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:51.711447 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.711942 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.712799 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.713005 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.713086 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.713350 (+ 264us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:51.713467 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:51.713572 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.713591 (+ 19us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.713614 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 21:04:51.715976 26622 raft_consensus.cc:1261] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634 [term 1 FOLLOWER]: Refusing update from remote peer 5a1a81056be146be950c9c72216433a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:51.715971 26411 raft_consensus.cc:1261] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c [term 1 FOLLOWER]: Refusing update from remote peer 5a1a81056be146be950c9c72216433a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:51.716368 26773 consensus_queue.cc:1035] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:51.716559 26772 consensus_queue.cc:1035] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:51.720219 26782 mvcc.cc:205] Tried to move back new op lower bound from 7317077572464795648 to 7317077572342550528. Current Snapshot: MvccSnapshot[applied={T|T < 7317077572464795648}]
I20260810 21:04:51.723255 24822 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:51.723371 24822 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37308:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:51.723752 26783 mvcc.cc:205] Tried to move back new op lower bound from 7317077572464795648 to 7317077572342550528. Current Snapshot: MvccSnapshot[applied={T|T < 7317077572464795648 or (T in {7317077572464795648})}]
I20260810 21:04:51.725118 24822 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d91d286f2ad04cb6af2bbe5b590be3b5: Sending DeleteTablet for 3 replicas of tablet f14c8c119236409f80aaaae1d37d4d25
I20260810 21:04:51.725535 26145 tablet_service.cc:1514] Processing DeleteTablet for tablet f14c8c119236409f80aaaae1d37d4d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:51 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:46662
I20260810 21:04:51.725560 26595 tablet_service.cc:1514] Processing DeleteTablet for tablet f14c8c119236409f80aaaae1d37d4d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:51 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:55350
I20260810 21:04:51.725602 26381 tablet_service.cc:1514] Processing DeleteTablet for tablet f14c8c119236409f80aaaae1d37d4d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:51 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:45944
I20260810 21:04:51.726058 26797 tablet_replica.cc:330] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c: stopping tablet replica
I20260810 21:04:51.726089 26796 tablet_replica.cc:330] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8: stopping tablet replica
I20260810 21:04:51.726183 26797 raft_consensus.cc:2229] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:51.726183 26796 raft_consensus.cc:2229] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:04:51.726275 26796 raft_consensus.cc:2258] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:51.726284 26797 raft_consensus.cc:2258] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:51.726565 26794 tablet_replica.cc:330] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634: stopping tablet replica
I20260810 21:04:51.726667 26794 raft_consensus.cc:2229] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:51.726768 26794 raft_consensus.cc:2258] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:51.726919 26796 ts_tablet_manager.cc:1905] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:51.727244 26794 ts_tablet_manager.cc:1905] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:51.727878 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 24777
I20260810 21:04:51.741189 26794 ts_tablet_manager.cc:1918] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:51.741308 26794 log.cc:1196] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/f14c8c119236409f80aaaae1d37d4d25
I20260810 21:04:51.741613 26794 ts_tablet_manager.cc:1939] T f14c8c119236409f80aaaae1d37d4d25 P 4c9351d65b0b441c8a58fc399023e634: Deleting consensus metadata
I20260810 21:04:51.743037 26796 ts_tablet_manager.cc:1918] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:51.743134 26796 log.cc:1196] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-0/wal/wals/f14c8c119236409f80aaaae1d37d4d25
I20260810 21:04:51.743484 26796 ts_tablet_manager.cc:1939] T f14c8c119236409f80aaaae1d37d4d25 P 5a1a81056be146be950c9c72216433a8: Deleting consensus metadata
I20260810 21:04:51.750253 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.727572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48638 (local address 127.15.37.60:43581)
0810 21:04:51.727663 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.727665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.727676 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:04:51.727716 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.727717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.727728 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.727802 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.744111 (+ 16309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.744762 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.745638 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.745860 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.745948 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.747489 (+ 1541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.747491 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.747491 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.747499 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.749042 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.749397 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.749399 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.749399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.749459 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.749670 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.749671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.749671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.749800 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.749907 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.750036 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.750135 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260810 21:04:51.751268 26522 connection.cc:535] server connection from 127.0.0.1:55350 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 21:04:51.751623 26079 connection.cc:535] server connection from 127.0.0.1:46662 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 21:04:51.752573 26797 ts_tablet_manager.cc:1905] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:51.754868 26797 ts_tablet_manager.cc:1918] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:51.755041 26797 log.cc:1196] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/f14c8c119236409f80aaaae1d37d4d25
I20260810 21:04:51.755421 26797 ts_tablet_manager.cc:1939] T f14c8c119236409f80aaaae1d37d4d25 P cc606120767a40989937f0a334aff24c: Deleting consensus metadata
W20260810 21:04:51.755915 26302 connection.cc:441] server connection from 127.0.0.1:45944 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45944 (request call id 1) could send its response
I20260810 21:04:51.762811 26708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.753618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48654 (local address 127.15.37.60:43581)
0810 21:04:51.753724 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.753725 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.754049 (+ 324us) server_negotiation.cc:407] Connection header received
0810 21:04:51.754160 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.754161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.754173 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.754206 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.756370 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.757038 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.757984 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.758272 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.758311 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.759774 (+ 1463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.759775 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.759775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.759783 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.761618 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.761997 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.761999 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.761999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.762064 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.762277 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.762278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.762278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.762404 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.762505 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.762618 (+ 113us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.762701 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260810 21:04:51.763168 26734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:51.753485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49314 (local address 127.15.37.61:36981)
0810 21:04:51.753541 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:51.753543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:51.754064 (+ 521us) server_negotiation.cc:407] Connection header received
0810 21:04:51.754168 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:51.754169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:51.754187 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:51.754218 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:51.755882 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.756779 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.757883 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:51.758193 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:51.758262 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:51.759887 (+ 1625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:51.759888 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:51.759889 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:51.759897 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:51.761868 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.762282 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.762283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.762284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.762341 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:51.762552 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:51.762552 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:51.762553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:51.762690 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:51.762763 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:51.762971 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 21:04:51.763071 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 21:04:52.722383 26814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:52.722085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.2:41041)
0810 21:04:52.722228 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:52.722317 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":69,"threads_started":1}
W20260810 21:04:52.722708 26484 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:34421 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
I20260810 21:04:52.723016 26815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:52.722779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.3:49877)
0810 21:04:52.722907 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:52.722977 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
W20260810 21:04:52.723337 26697 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:34421 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
I20260810 21:04:52.726681 26816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:52.726464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.1:46697)
0810 21:04:52.726580 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:52.726639 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":60,"threads_started":1}
W20260810 21:04:52.726948 26246 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:34421 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
I20260810 21:04:53.225292 26819 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d91d286f2ad04cb6af2bbe5b590be3b5)
I20260810 21:04:53.225292 26817 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d91d286f2ad04cb6af2bbe5b590be3b5)
I20260810 21:04:53.225450 26819 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } }
I20260810 21:04:53.225507 26817 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } }
I20260810 21:04:53.225811 26817 leader_election.cc:288] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d91d286f2ad04cb6af2bbe5b590be3b5 (127.15.37.62:34421), 86a5be9470f243938e2033f6ca57747c (127.15.37.60:43581)
I20260810 21:04:53.225829 26819 leader_election.cc:288] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d91d286f2ad04cb6af2bbe5b590be3b5 (127.15.37.62:34421), 7b2a2571606b48b6b720acc0a972ec1a (127.15.37.61:36981)
I20260810 21:04:53.226238 26820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.225958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37816)
0810 21:04:53.226123 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:53.226182 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":94,"threads_started":1}
W20260810 21:04:53.226382 25965 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
I20260810 21:04:53.226632 26825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.226376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37832)
0810 21:04:53.226529 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:53.226590 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":45,"threads_started":1}
W20260810 21:04:53.226848 25696 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
I20260810 21:04:53.227066 26820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.226875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37840)
0810 21:04:53.227010 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:53.227038 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
W20260810 21:04:53.227169 25965 leader_election.cc:334] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d91d286f2ad04cb6af2bbe5b590be3b5 (127.15.37.62:34421): Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
I20260810 21:04:53.227517 26825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.227402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37842)
0810 21:04:53.227460 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:53.227491 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260810 21:04:53.227598 25696 leader_election.cc:334] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d91d286f2ad04cb6af2bbe5b590be3b5 (127.15.37.62:34421): Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
I20260810 21:04:53.229811 26823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.226177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48662 (local address 127.15.37.60:43581)
0810 21:04:53.226360 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:53.226362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:53.226373 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:04:53.226484 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:53.226485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:53.226496 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:53.226586 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:53.226779 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:53.227546 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:53.229063 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:53.229425 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:53.229525 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:53.229536 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:53.229708 (+ 172us) server_negotiation.cc:299] Negotiation successful
0810 21:04:53.229743 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":40,"threads_started":1}
I20260810 21:04:53.229811 26822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.226022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:36981 (local address 127.0.0.1:49328)
0810 21:04:53.226154 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:53.226166 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:53.226227 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:53.226630 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:53.226631 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:53.226635 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:53.226702 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:53.226704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:53.227712 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:53.227713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:53.228934 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:53.228938 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:53.229533 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:53.229534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:53.229596 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:53.229598 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 21:04:53.229672 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 21:04:53.229723 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":48,"threads_started":1}
I20260810 21:04:53.229833 26824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.226258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49328 (local address 127.15.37.61:36981)
0810 21:04:53.226433 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:53.226435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:53.226443 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:04:53.226470 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:53.226471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:53.226483 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:53.226780 (+ 297us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:53.226856 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:53.227601 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:53.229051 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:53.229420 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:53.229518 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:53.229528 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:53.229691 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 21:04:53.229735 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":53,"threads_started":1}
I20260810 21:04:53.229832 26821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.225999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:43581 (local address 127.0.0.1:48662)
0810 21:04:53.226319 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:53.226329 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:53.226376 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:53.226644 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:53.226645 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:53.226647 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:53.226705 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:53.226707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:53.227646 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:53.227648 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:53.228934 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:53.228937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:53.229563 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:53.229564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:53.229600 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:53.229602 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 21:04:53.229702 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 21:04:53.229737 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":76,"threads_started":1}
I20260810 21:04:53.230165 25733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86a5be9470f243938e2033f6ca57747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7b2a2571606b48b6b720acc0a972ec1a" is_pre_election: true
I20260810 21:04:53.230322 25733 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86a5be9470f243938e2033f6ca57747c in term 1.
I20260810 21:04:53.230355 25999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b2a2571606b48b6b720acc0a972ec1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "86a5be9470f243938e2033f6ca57747c" is_pre_election: true
I20260810 21:04:53.230487 25999 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b2a2571606b48b6b720acc0a972ec1a in term 1.
I20260810 21:04:53.230485 25963 leader_election.cc:302] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b2a2571606b48b6b720acc0a972ec1a, 86a5be9470f243938e2033f6ca57747c; no voters: d91d286f2ad04cb6af2bbe5b590be3b5
I20260810 21:04:53.230640 26819 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 21:04:53.230674 25694 leader_election.cc:302] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b2a2571606b48b6b720acc0a972ec1a, 86a5be9470f243938e2033f6ca57747c; no voters: d91d286f2ad04cb6af2bbe5b590be3b5
I20260810 21:04:53.230698 26819 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 FOLLOWER]: Starting leader election (detected failure of leader d91d286f2ad04cb6af2bbe5b590be3b5)
I20260810 21:04:53.230726 26819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 1 FOLLOWER]: Advancing to term 2
I20260810 21:04:53.230762 26817 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 21:04:53.230800 26817 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 FOLLOWER]: Starting leader election (detected failure of leader d91d286f2ad04cb6af2bbe5b590be3b5)
I20260810 21:04:53.230852 26817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 1 FOLLOWER]: Advancing to term 2
I20260810 21:04:53.231580 26817 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } }
I20260810 21:04:53.231585 26819 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } }
I20260810 21:04:53.231724 26817 leader_election.cc:288] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [CANDIDATE]: Term 2 election: Requested vote from peers d91d286f2ad04cb6af2bbe5b590be3b5 (127.15.37.62:34421), 86a5be9470f243938e2033f6ca57747c (127.15.37.60:43581)
I20260810 21:04:53.231740 26819 leader_election.cc:288] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [CANDIDATE]: Term 2 election: Requested vote from peers d91d286f2ad04cb6af2bbe5b590be3b5 (127.15.37.62:34421), 7b2a2571606b48b6b720acc0a972ec1a (127.15.37.61:36981)
I20260810 21:04:53.231936 26822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.231823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37862)
0810 21:04:53.231869 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:53.231903 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260810 21:04:53.231951 25733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "86a5be9470f243938e2033f6ca57747c" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7b2a2571606b48b6b720acc0a972ec1a"
I20260810 21:04:53.231968 25999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b2a2571606b48b6b720acc0a972ec1a" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "86a5be9470f243938e2033f6ca57747c"
I20260810 21:04:53.232054 25999 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b2a2571606b48b6b720acc0a972ec1a in current term 2: Already voted for candidate 86a5be9470f243938e2033f6ca57747c in this term.
I20260810 21:04:53.232055 25733 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 86a5be9470f243938e2033f6ca57747c in current term 2: Already voted for candidate 7b2a2571606b48b6b720acc0a972ec1a in this term.
I20260810 21:04:53.231961 26821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.231815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37848)
0810 21:04:53.231869 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:53.231902 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 21:04:53.232242 26822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.232160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37864)
0810 21:04:53.232197 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:53.232221 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260810 21:04:53.232300 25965 leader_election.cc:334] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d91d286f2ad04cb6af2bbe5b590be3b5 (127.15.37.62:34421): Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
I20260810 21:04:53.232339 25963 leader_election.cc:302] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 86a5be9470f243938e2033f6ca57747c; no voters: 7b2a2571606b48b6b720acc0a972ec1a, d91d286f2ad04cb6af2bbe5b590be3b5
I20260810 21:04:53.232383 26821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.232300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:37868)
0810 21:04:53.232336 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:53.232361 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260810 21:04:53.232414 26819 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260810 21:04:53.232441 25696 leader_election.cc:334] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d91d286f2ad04cb6af2bbe5b590be3b5 (127.15.37.62:34421): Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
I20260810 21:04:53.232503 25696 leader_election.cc:302] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b2a2571606b48b6b720acc0a972ec1a; no voters: 86a5be9470f243938e2033f6ca57747c, d91d286f2ad04cb6af2bbe5b590be3b5
I20260810 21:04:53.232564 26817 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 21:04:53.723342 26829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.723102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.2:41607)
0810 21:04:53.723253 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:53.723292 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":85,"threads_started":1}
I20260810 21:04:53.723927 26830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.723696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.3:52393)
0810 21:04:53.723829 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:53.723871 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260810 21:04:53.727514 26832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:53.727283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.1:60859)
0810 21:04:53.727426 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:53.727462 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
I20260810 21:04:54.724279 26833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:54.724003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.2:33553)
0810 21:04:54.724160 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:54.724225 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":81,"threads_started":1}
I20260810 21:04:54.724727 26835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:54.724507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.3:43851)
0810 21:04:54.724630 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:54.724667 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":58,"threads_started":1}
I20260810 21:04:54.728276 26837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:54.728019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.1:52409)
0810 21:04:54.728196 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:54.728231 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":120,"threads_started":1}
I20260810 21:04:55.474825 26839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:55.474972 26839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } }
I20260810 21:04:55.475195 26839 leader_election.cc:288] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d91d286f2ad04cb6af2bbe5b590be3b5 (127.15.37.62:34421), 86a5be9470f243938e2033f6ca57747c (127.15.37.60:43581)
I20260810 21:04:55.475538 25999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b2a2571606b48b6b720acc0a972ec1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "86a5be9470f243938e2033f6ca57747c" is_pre_election: true
I20260810 21:04:55.475584 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.475342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:54528)
0810 21:04:55.475487 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.475540 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":75,"threads_started":1}
I20260810 21:04:55.475636 25999 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b2a2571606b48b6b720acc0a972ec1a in term 2.
I20260810 21:04:55.475811 25694 leader_election.cc:302] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b2a2571606b48b6b720acc0a972ec1a, 86a5be9470f243938e2033f6ca57747c; no voters:
I20260810 21:04:55.475970 26839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 21:04:55.476013 26839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:55.476037 26839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 2 FOLLOWER]: Advancing to term 3
I20260810 21:04:55.476110 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.475986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:54544)
0810 21:04:55.476046 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.476084 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 21:04:55.476205 25696 leader_election.cc:334] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d91d286f2ad04cb6af2bbe5b590be3b5 (127.15.37.62:34421): Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
I20260810 21:04:55.477002 26839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } }
I20260810 21:04:55.477173 26839 leader_election.cc:288] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [CANDIDATE]: Term 3 election: Requested vote from peers d91d286f2ad04cb6af2bbe5b590be3b5 (127.15.37.62:34421), 86a5be9470f243938e2033f6ca57747c (127.15.37.60:43581)
I20260810 21:04:55.477360 25999 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7b2a2571606b48b6b720acc0a972ec1a" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "86a5be9470f243938e2033f6ca57747c"
I20260810 21:04:55.477471 25999 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 2 FOLLOWER]: Advancing to term 3
I20260810 21:04:55.477504 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.477382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:54560)
0810 21:04:55.477445 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.477473 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 21:04:55.477823 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.477707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:54572)
0810 21:04:55.477752 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.477798 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 21:04:55.477907 25696 leader_election.cc:334] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d91d286f2ad04cb6af2bbe5b590be3b5 (127.15.37.62:34421): Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
I20260810 21:04:55.478327 25999 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b2a2571606b48b6b720acc0a972ec1a in term 3.
I20260810 21:04:55.478502 25694 leader_election.cc:302] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b2a2571606b48b6b720acc0a972ec1a, 86a5be9470f243938e2033f6ca57747c; no voters: d91d286f2ad04cb6af2bbe5b590be3b5
I20260810 21:04:55.478605 26839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 3 FOLLOWER]: Leader election won for term 3
I20260810 21:04:55.478714 26839 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [term 3 LEADER]: Becoming Leader. State: Replica: 7b2a2571606b48b6b720acc0a972ec1a, State: Running, Role: LEADER
I20260810 21:04:55.478801 26839 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } }
I20260810 21:04:55.479249 26842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b2a2571606b48b6b720acc0a972ec1a. Latest consensus state: current_term: 3 leader_uuid: "7b2a2571606b48b6b720acc0a972ec1a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } } }
I20260810 21:04:55.479341 26842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:55.479521 26844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:55.480074 26844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:55.480186 26844 catalog_manager.cc:1259] Loaded cluster ID: 4d1ff3fb82c349de81f5eb1bb9ef3da7
I20260810 21:04:55.480219 26844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:04:55.480420 26844 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:55.480536 26844 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: Loaded TSK: 0
I20260810 21:04:55.480690 26844 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:04:55.524436 25715 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49314:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:55.527176 25715 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:55.528453 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.528302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:54588)
0810 21:04:55.528374 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.528424 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 21:04:55.528570 25999 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [term 3 FOLLOWER]: Refusing update from remote peer 7b2a2571606b48b6b720acc0a972ec1a: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260810 21:04:55.528925 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.528760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.0.0.1:54604)
0810 21:04:55.528823 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.528861 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 21:04:55.528867 26839 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260810 21:04:55.529165 25696 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a -> Peer d91d286f2ad04cb6af2bbe5b590be3b5 (127.15.37.62:34421): Couldn't send request to peer d91d286f2ad04cb6af2bbe5b590be3b5. Status: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 21:04:55.529659 26847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b2a2571606b48b6b720acc0a972ec1a. Latest consensus state: current_term: 3 leader_uuid: "7b2a2571606b48b6b720acc0a972ec1a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } } }
I20260810 21:04:55.529779 26847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:04:55.530280 26845 mvcc.cc:205] Tried to move back new op lower bound from 7317077588082008064 to 7317077587882135552. Current Snapshot: MvccSnapshot[applied={T|T < 7317077588082008064}]
I20260810 21:04:55.530409 26839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "7b2a2571606b48b6b720acc0a972ec1a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } } }
I20260810 21:04:55.530507 26839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:55.530459 26847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "7b2a2571606b48b6b720acc0a972ec1a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "d91d286f2ad04cb6af2bbe5b590be3b5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 34421 } } peers { permanent_uuid: "7b2a2571606b48b6b720acc0a972ec1a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 36981 } attrs { promote: false } } peers { permanent_uuid: "86a5be9470f243938e2033f6ca57747c" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 43581 } attrs { promote: false } } }
I20260810 21:04:55.530578 26847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a5be9470f243938e2033f6ca57747c [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:04:55.530663 26848 mvcc.cc:205] Tried to move back new op lower bound from 7317077588082008064 to 7317077587882135552. Current Snapshot: MvccSnapshot[applied={T|T < 7317077588082008064 or (T in {7317077588082008064})}]
I20260810 21:04:55.536533 26865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.533099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33884 (local address 127.15.37.3:40731)
0810 21:04:55.533330 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:55.533332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:55.533341 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:04:55.533372 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:55.533373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:55.533387 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:55.533736 (+ 349us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:55.533779 (+ 43us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.534514 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.535718 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.536113 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.536204 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:55.536220 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:55.536375 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 21:04:55.536417 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":57,"threads_started":1}
I20260810 21:04:55.536532 26859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.532873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:40731 (local address 127.0.0.1:33884)
0810 21:04:55.533028 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.533039 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:55.533089 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:55.533622 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:55.533624 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:55.533626 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:55.533670 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:55.533672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.534593 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.534594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:55.535633 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:55.535635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.536205 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.536206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:55.536273 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:55.536277 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:55.536366 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 21:04:55.536414 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":94,"threads_started":1}
I20260810 21:04:55.536667 26866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.533092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47994 (local address 127.15.37.2:37153)
0810 21:04:55.533232 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:55.533234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:55.533244 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:04:55.533472 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:55.533473 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:55.533485 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:55.533549 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:55.533678 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.534195 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.535560 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.536160 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.536228 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:55.536241 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:55.536563 (+ 322us) server_negotiation.cc:299] Negotiation successful
0810 21:04:55.536602 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":68,"threads_started":1}
I20260810 21:04:55.536537 26856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.532915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:37153 (local address 127.0.0.1:47994)
0810 21:04:55.533184 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.533194 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:55.533233 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:55.533550 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:55.533551 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:55.533553 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:55.533584 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:55.533585 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.534304 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.534305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:55.535462 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:55.535465 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.536273 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.536274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:55.536336 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:55.536340 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:55.536383 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 21:04:55.536424 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":61,"threads_started":1}
I20260810 21:04:55.537051 26381 tablet_service.cc:1467] Processing CreateTablet for tablet c5d8054d6a284cb7b64d93608ca0e583 (DEFAULT_TABLE table=test-table [id=a3aacd774d9e46e896cf91117d0da9fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:55.537225 26381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5d8054d6a284cb7b64d93608ca0e583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:55.537472 26595 tablet_service.cc:1467] Processing CreateTablet for tablet c5d8054d6a284cb7b64d93608ca0e583 (DEFAULT_TABLE table=test-table [id=a3aacd774d9e46e896cf91117d0da9fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:55.537623 26595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5d8054d6a284cb7b64d93608ca0e583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:55.537671 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.532821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:38509 (local address 127.0.0.1:57158)
0810 21:04:55.532883 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.532896 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:55.532960 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:55.533493 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:55.533493 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:55.533496 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:55.533559 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:55.533560 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.534542 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.534543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:55.536672 (+ 2129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:55.536676 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.537443 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.537444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:55.537512 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:55.537516 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:55.537550 (+ 34us) client_negotiation.cc:240] Negotiation successful
0810 21:04:55.537597 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":1023}
I20260810 21:04:55.537992 26863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.532935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57158 (local address 127.15.37.1:38509)
0810 21:04:55.533344 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:55.533346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:55.533355 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:04:55.533381 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:55.533382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:55.533392 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:55.533486 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:55.533633 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.534430 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.536803 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.537331 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.537833 (+ 502us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:55.537854 (+ 21us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:55.537874 (+ 20us) server_negotiation.cc:299] Negotiation successful
0810 21:04:55.537925 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":70,"threads_started":1}
I20260810 21:04:55.538187 26145 tablet_service.cc:1467] Processing CreateTablet for tablet c5d8054d6a284cb7b64d93608ca0e583 (DEFAULT_TABLE table=test-table [id=a3aacd774d9e46e896cf91117d0da9fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:55.538311 26145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c5d8054d6a284cb7b64d93608ca0e583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:55.538817 26867 tablet_bootstrap.cc:492] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c: Bootstrap starting.
I20260810 21:04:55.539259 26868 tablet_bootstrap.cc:492] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634: Bootstrap starting.
I20260810 21:04:55.539414 26867 tablet_bootstrap.cc:654] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:55.539662 26868 tablet_bootstrap.cc:654] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:55.539840 26870 tablet_bootstrap.cc:492] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8: Bootstrap starting.
I20260810 21:04:55.540253 26868 tablet_bootstrap.cc:492] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634: No bootstrap required, opened a new log
I20260810 21:04:55.540302 26867 tablet_bootstrap.cc:492] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c: No bootstrap required, opened a new log
I20260810 21:04:55.540313 26870 tablet_bootstrap.cc:654] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:55.540325 26868 ts_tablet_manager.cc:1397] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:55.540351 26867 ts_tablet_manager.cc:1397] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:04:55.540469 26868 raft_consensus.cc:348] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } }
I20260810 21:04:55.540616 26868 raft_consensus.cc:374] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:55.540573 26867 raft_consensus.cc:348] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } }
I20260810 21:04:55.540645 26868 raft_consensus.cc:729] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9351d65b0b441c8a58fc399023e634, State: Initialized, Role: FOLLOWER
I20260810 21:04:55.540664 26867 raft_consensus.cc:374] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:55.540701 26867 raft_consensus.cc:729] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc606120767a40989937f0a334aff24c, State: Initialized, Role: FOLLOWER
I20260810 21:04:55.540689 26868 consensus_queue.cc:260] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } }
I20260810 21:04:55.540756 26867 consensus_queue.cc:260] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } }
I20260810 21:04:55.540843 26868 ts_tablet_manager.cc:1428] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:55.540876 26870 tablet_bootstrap.cc:492] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8: No bootstrap required, opened a new log
I20260810 21:04:55.540925 26867 ts_tablet_manager.cc:1428] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:55.540934 26870 ts_tablet_manager.cc:1397] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:55.541043 26870 raft_consensus.cc:348] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } }
I20260810 21:04:55.541114 26870 raft_consensus.cc:374] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:55.541138 26870 raft_consensus.cc:729] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a1a81056be146be950c9c72216433a8, State: Initialized, Role: FOLLOWER
I20260810 21:04:55.541185 26870 consensus_queue.cc:260] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } }
I20260810 21:04:55.541327 26870 ts_tablet_manager.cc:1428] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 21:04:55.542026 26700 heartbeater.cc:503] Master 127.15.37.61:36981 was elected leader, sending a full tablet report...
I20260810 21:04:55.542083 26247 heartbeater.cc:503] Master 127.15.37.61:36981 was elected leader, sending a full tablet report...
I20260810 21:04:55.542564 26877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.541181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.2:37481)
0810 21:04:55.542467 (+ 1286us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.542510 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1259,"thread_start_us":82,"threads_started":1}
I20260810 21:04:55.542599 26485 heartbeater.cc:503] Master 127.15.37.61:36981 was elected leader, sending a full tablet report...
I20260810 21:04:55.542714 26880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.541693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.3:59349)
0810 21:04:55.542616 (+ 923us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.542656 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":897,"thread_start_us":84,"threads_started":1}
I20260810 21:04:55.542877 26881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.542400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.1:59863)
0810 21:04:55.542811 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.542845 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":83,"threads_started":1}
I20260810 21:04:55.543193 26877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.543094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.2:58911)
0810 21:04:55.543134 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.543166 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260810 21:04:55.543351 26881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.543145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.1:57413)
0810 21:04:55.543304 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.543331 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
I20260810 21:04:55.700271 26878 raft_consensus.cc:482] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:55.700377 26878 raft_consensus.cc:504] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } }
I20260810 21:04:55.700737 26878 leader_election.cc:288] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c9351d65b0b441c8a58fc399023e634 (127.15.37.3:40731), cc606120767a40989937f0a334aff24c (127.15.37.2:37153)
I20260810 21:04:55.700923 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5d8054d6a284cb7b64d93608ca0e583" candidate_uuid: "5a1a81056be146be950c9c72216433a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9351d65b0b441c8a58fc399023e634" is_pre_election: true
I20260810 21:04:55.700933 26411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5d8054d6a284cb7b64d93608ca0e583" candidate_uuid: "5a1a81056be146be950c9c72216433a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc606120767a40989937f0a334aff24c" is_pre_election: true
I20260810 21:04:55.701016 26622 raft_consensus.cc:2454] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a1a81056be146be950c9c72216433a8 in term 0.
I20260810 21:04:55.701066 26411 raft_consensus.cc:2454] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a1a81056be146be950c9c72216433a8 in term 0.
I20260810 21:04:55.701253 26079 leader_election.cc:302] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9351d65b0b441c8a58fc399023e634, 5a1a81056be146be950c9c72216433a8; no voters:
I20260810 21:04:55.701371 26878 raft_consensus.cc:2781] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:55.701406 26878 raft_consensus.cc:482] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:55.701447 26878 raft_consensus.cc:3037] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:55.702333 26878 raft_consensus.cc:504] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } }
I20260810 21:04:55.702508 26878 leader_election.cc:288] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [CANDIDATE]: Term 1 election: Requested vote from peers 4c9351d65b0b441c8a58fc399023e634 (127.15.37.3:40731), cc606120767a40989937f0a334aff24c (127.15.37.2:37153)
I20260810 21:04:55.702709 26411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5d8054d6a284cb7b64d93608ca0e583" candidate_uuid: "5a1a81056be146be950c9c72216433a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc606120767a40989937f0a334aff24c"
I20260810 21:04:55.702818 26411 raft_consensus.cc:3037] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:55.702795 26622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c5d8054d6a284cb7b64d93608ca0e583" candidate_uuid: "5a1a81056be146be950c9c72216433a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c9351d65b0b441c8a58fc399023e634"
I20260810 21:04:55.702890 26622 raft_consensus.cc:3037] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:55.703660 26622 raft_consensus.cc:2454] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a1a81056be146be950c9c72216433a8 in term 1.
I20260810 21:04:55.703660 26411 raft_consensus.cc:2454] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a1a81056be146be950c9c72216433a8 in term 1.
I20260810 21:04:55.703858 26079 leader_election.cc:302] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c9351d65b0b441c8a58fc399023e634, 5a1a81056be146be950c9c72216433a8; no voters:
I20260810 21:04:55.703950 26878 raft_consensus.cc:2781] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:55.704131 26878 raft_consensus.cc:686] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [term 1 LEADER]: Becoming Leader. State: Replica: 5a1a81056be146be950c9c72216433a8, State: Running, Role: LEADER
I20260810 21:04:55.704180 26878 consensus_queue.cc:237] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } }
I20260810 21:04:55.704607 26881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.704391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.1:43193)
0810 21:04:55.704521 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.704564 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260810 21:04:55.705219 25716 catalog_manager.cc:5495] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a1a81056be146be950c9c72216433a8 (127.15.37.1). New cstate: current_term: 1 leader_uuid: "5a1a81056be146be950c9c72216433a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5a1a81056be146be950c9c72216433a8" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 } health_report { overall_health: UNKNOWN } } }
I20260810 21:04:55.721347 26863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.718988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57172 (local address 127.15.37.1:38509)
0810 21:04:55.719056 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:55.719057 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:55.719066 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:04:55.719096 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:55.719097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:55.719110 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:55.719220 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:55.719346 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.719829 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.720689 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:55.720905 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:55.720960 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:55.721096 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:55.721126 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:55.721164 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:55.721215 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 21:04:55.721236 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 21:04:55.722393 26411 raft_consensus.cc:1261] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c [term 1 FOLLOWER]: Refusing update from remote peer 5a1a81056be146be950c9c72216433a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:55.722445 26622 raft_consensus.cc:1261] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634 [term 1 FOLLOWER]: Refusing update from remote peer 5a1a81056be146be950c9c72216433a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:55.722671 26882 consensus_queue.cc:1035] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc606120767a40989937f0a334aff24c" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:55.722795 26878 consensus_queue.cc:1035] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c9351d65b0b441c8a58fc399023e634" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 40731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:55.723464 26880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.723340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.3:38731)
0810 21:04:55.723388 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.723423 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 21:04:55.724287 26877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.723733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.2:44453)
0810 21:04:55.724214 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.724250 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460}
I20260810 21:04:55.724738 26881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.724632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.1:58545)
0810 21:04:55.724675 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.724703 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 21:04:55.726161 25716 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:55.726249 25716 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:55.726269 26877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.726179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.2:37811)
0810 21:04:55.726214 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.726242 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260810 21:04:55.726495 26881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.726400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.1:39937)
0810 21:04:55.726437 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.726468 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260810 21:04:55.727232 26880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.727126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:34421 (local address 127.15.37.3:47463)
0810 21:04:55.727168 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.727196 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:34421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260810 21:04:55.728031 25716 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b2a2571606b48b6b720acc0a972ec1a: Sending DeleteTablet for 3 replicas of tablet c5d8054d6a284cb7b64d93608ca0e583
I20260810 21:04:55.728260 26595 tablet_service.cc:1514] Processing DeleteTablet for tablet c5d8054d6a284cb7b64d93608ca0e583 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:55 UTC) from {username='oryx', principal='oryx/127.15.37.61@KRBTEST.COM'} at 127.0.0.1:33884
I20260810 21:04:55.728307 26594 tablet_service.cc:1514] Processing DeleteTablet for tablet c5d8054d6a284cb7b64d93608ca0e583 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:55 UTC) from {username='oryx', principal='oryx/127.15.37.61@KRBTEST.COM'} at 127.0.0.1:33884
I20260810 21:04:55.728370 26145 tablet_service.cc:1514] Processing DeleteTablet for tablet c5d8054d6a284cb7b64d93608ca0e583 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:55 UTC) from {username='oryx', principal='oryx/127.15.37.61@KRBTEST.COM'} at 127.0.0.1:57158
I20260810 21:04:55.728394 26381 tablet_service.cc:1514] Processing DeleteTablet for tablet c5d8054d6a284cb7b64d93608ca0e583 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:55 UTC) from {username='oryx', principal='oryx/127.15.37.61@KRBTEST.COM'} at 127.0.0.1:47994
I20260810 21:04:55.728470 26898 tablet_replica.cc:330] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634: stopping tablet replica
I20260810 21:04:55.728578 26898 raft_consensus.cc:2229] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:55.728621 26904 tablet_replica.cc:330] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c: stopping tablet replica
I20260810 21:04:55.728693 26903 tablet_replica.cc:330] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8: stopping tablet replica
I20260810 21:04:55.728721 26898 raft_consensus.cc:2258] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:55.728721 26904 raft_consensus.cc:2229] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:55.728778 26904 raft_consensus.cc:2258] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:55.728816 26903 raft_consensus.cc:2229] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:04:55.728888 26903 raft_consensus.cc:2258] T c5d8054d6a284cb7b64d93608ca0e583 P 5a1a81056be146be950c9c72216433a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:55.729127 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 25929
I20260810 21:04:55.729198 26898 ts_tablet_manager.cc:1905] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:55.731386 26898 ts_tablet_manager.cc:1918] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:55.731455 26898 log.cc:1196] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/c5d8054d6a284cb7b64d93608ca0e583
I20260810 21:04:55.731761 26898 ts_tablet_manager.cc:1939] T c5d8054d6a284cb7b64d93608ca0e583 P 4c9351d65b0b441c8a58fc399023e634: Deleting consensus metadata
I20260810 21:04:55.732196 25698 catalog_manager.cc:4841] TS 4c9351d65b0b441c8a58fc399023e634 (127.15.37.3:40731): tablet c5d8054d6a284cb7b64d93608ca0e583 (table test-table [id=a3aacd774d9e46e896cf91117d0da9fc]) successfully deleted
W20260810 21:04:55.732456 25698 catalog_manager.cc:4808] TS 4c9351d65b0b441c8a58fc399023e634 (127.15.37.3:40731): delete failed for tablet c5d8054d6a284cb7b64d93608ca0e583 because the tablet was not found. No further retry: Not found: Tablet not found: c5d8054d6a284cb7b64d93608ca0e583
I20260810 21:04:55.740087 26904 ts_tablet_manager.cc:1905] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:55.741765 26904 ts_tablet_manager.cc:1918] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:55.741863 26904 log.cc:1196] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/c5d8054d6a284cb7b64d93608ca0e583
I20260810 21:04:55.742098 26904 ts_tablet_manager.cc:1939] T c5d8054d6a284cb7b64d93608ca0e583 P cc606120767a40989937f0a334aff24c: Deleting consensus metadata
I20260810 21:04:55.742532 25695 catalog_manager.cc:4841] TS cc606120767a40989937f0a334aff24c (127.15.37.2:37153): tablet c5d8054d6a284cb7b64d93608ca0e583 (table test-table [id=a3aacd774d9e46e896cf91117d0da9fc]) successfully deleted
I20260810 21:04:55.745836 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 26253
I20260810 21:04:55.745877 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:55.745723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:38509 (local address 127.0.0.1:57184)
0810 21:04:55.745793 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:55.745834 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:38509: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 21:04:55.748821 25695 catalog_manager.cc:4584] TS 5a1a81056be146be950c9c72216433a8 (127.15.37.1:38509): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c5d8054d6a284cb7b64d93608ca0e583: Network error: Client connection negotiation failed: client connection to 127.15.37.1:38509: connect: Connection refused (error 111)
I20260810 21:04:55.758370 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 26492
I20260810 21:04:55.775406 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 25517
I20260810 21:04:55.786085 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 25797
2026-08-10T21:04:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7471 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:04:55 dist-test-slave-jq4t krb5kdc[26908](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:04:55 dist-test-slave-jq4t krb5kdc[26908](info): set up 2 sockets
Aug 10 21:04:55 dist-test-slave-jq4t krb5kdc[26908](info): commencing operation
krb5kdc: starting...
W20260810 21:04:57.085112 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:04:57 dist-test-slave-jq4t krb5kdc[26908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:04:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:04:57Z Disabled control of system clock
WARNING: no policy specified for oryx/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.62.keytab.
Entry for principal oryx/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.62.keytab.
I20260810 21:04:57.219810 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:44617
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.62.keytab
--principal=oryx/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:38005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:44617
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:57.305341 26927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:57.305578 26927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:57.305603 26927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:57.306717 26927 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:04:57.306756 26927 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 21:04:57.306769 26927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:57.306783 26927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:57.306797 26927 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:04:57.306808 26927 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:04:57.308326 26927 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:38005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:44617
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.62.keytab
--principal=oryx/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:44617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:57.308625 26927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:57.308833 26927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:57.313803 26932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:57.313817 26943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:57.313835 26927 server_base.cc:1034] running on GCE node
W20260810 21:04:57.313838 26933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:57.314304 26927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:57.314669 26927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:57.315862 26927 hybrid_clock.cc:648] HybridClock initialized: now 1786395897315848 us; error 42 us; skew 500 ppm
Aug 10 21:04:57 dist-test-slave-jq4t krb5kdc[26908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395897, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:57.318717 26927 init.cc:377] Logged in from keytab as oryx/127.15.37.62@KRBTEST.COM (short username oryx)
I20260810 21:04:57.319149 26927 webserver.cc:460] Webserver started at http://127.15.37.62:42959/ using document root <none> and password file <none>
I20260810 21:04:57.319348 26927 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:57.319389 26927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:57.319481 26927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:57.320644 26927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "67d130a0e5984edea7bfa3537adc154a"
format_stamp: "Formatted at 2026-08-10 21:04:57 on dist-test-slave-jq4t"
server_key: "b83e2fcf380b998fd98afaa267d7f956"
server_key_iv: "4a73ba0b0549e8e99dc5e04194aa3836"
server_key_version: "encryptionkey@0"
I20260810 21:04:57.320974 26927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "67d130a0e5984edea7bfa3537adc154a"
format_stamp: "Formatted at 2026-08-10 21:04:57 on dist-test-slave-jq4t"
server_key: "b83e2fcf380b998fd98afaa267d7f956"
server_key_iv: "4a73ba0b0549e8e99dc5e04194aa3836"
server_key_version: "encryptionkey@0"
I20260810 21:04:57.322347 26927 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:04:57.323091 26950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:57.323295 26927 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:57.323385 26927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "67d130a0e5984edea7bfa3537adc154a"
format_stamp: "Formatted at 2026-08-10 21:04:57 on dist-test-slave-jq4t"
server_key: "b83e2fcf380b998fd98afaa267d7f956"
server_key_iv: "4a73ba0b0549e8e99dc5e04194aa3836"
server_key_version: "encryptionkey@0"
I20260810 21:04:57.323443 26927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:57.335983 26927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:57.338058 26927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:57.338176 26927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:57.343135 26927 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:44617
I20260810 21:04:57.343277 27047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:44617 every 8 connection(s)
I20260810 21:04:57.343595 26927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:04:57.344446 27048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:57.345760 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 26927
I20260810 21:04:57.345889 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:04:57.346095 15508 external_mini_cluster.cc:1428] Setting key 921405e51221b3a5f3a0d0884dfdd37c
I20260810 21:04:57.347432 27048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a: Bootstrap starting.
I20260810 21:04:57.348165 27048 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:57.348568 27048 log.cc:824] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:57.349313 27048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a: No bootstrap required, opened a new log
I20260810 21:04:57.351428 27048 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67d130a0e5984edea7bfa3537adc154a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44617 } }
I20260810 21:04:57.351624 27048 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:57.351676 27048 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d130a0e5984edea7bfa3537adc154a, State: Initialized, Role: FOLLOWER
I20260810 21:04:57.351810 27048 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67d130a0e5984edea7bfa3537adc154a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44617 } }
I20260810 21:04:57.351912 27048 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:04:57.351959 27048 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:04:57.352008 27048 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:57.352658 27048 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67d130a0e5984edea7bfa3537adc154a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44617 } }
I20260810 21:04:57.352773 27048 leader_election.cc:302] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67d130a0e5984edea7bfa3537adc154a; no voters:
I20260810 21:04:57.352967 27048 leader_election.cc:288] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:04:57.353014 27054 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [term 1 FOLLOWER]: Leader election won for term 1
Aug 10 21:04:57 dist-test-slave-jq4t krb5kdc[26908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:57.353232 27048 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:04:57.353703 27054 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [term 1 LEADER]: Becoming Leader. State: Replica: 67d130a0e5984edea7bfa3537adc154a, State: Running, Role: LEADER
I20260810 21:04:57.353857 27054 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67d130a0e5984edea7bfa3537adc154a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44617 } }
I20260810 21:04:57.355413 27055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67d130a0e5984edea7bfa3537adc154a. Latest consensus state: current_term: 1 leader_uuid: "67d130a0e5984edea7bfa3537adc154a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67d130a0e5984edea7bfa3537adc154a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44617 } } }
I20260810 21:04:57.355762 27055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [sys.catalog]: This master's current role is: LEADER
W20260810 21:04:57.355899 27071 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260810 21:04:57.355616 27057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67d130a0e5984edea7bfa3537adc154a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67d130a0e5984edea7bfa3537adc154a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44617 } } }
W20260810 21:04:57.355960 27071 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:04:57.355983 27057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a [sys.catalog]: This master's current role is: LEADER
I20260810 21:04:57.356163 27074 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:04:57.356346 27074 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:04:57.357642 27052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.346709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44112 (local address 127.15.37.62:44617)
0810 21:04:57.346908 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:57.346919 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:57.346955 (+ 36us) server_negotiation.cc:407] Connection header received
0810 21:04:57.347528 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:57.347538 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:57.347603 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:57.347749 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:57.348415 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.349513 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.350267 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.350717 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.350856 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.353714 (+ 2858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:57.353719 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:57.353719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:57.353733 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:57.355856 (+ 2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.356299 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.356302 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.356303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.356401 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.356654 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.356656 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.356657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.356980 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:57.357158 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:57.357276 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 21:04:57.357421 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":91,"threads_started":1}
I20260810 21:04:57.358337 27074 catalog_manager.cc:1347] Generated new cluster ID: bebf01b65a694d0faf8352a265bd4e14
I20260810 21:04:57.358393 27074 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:04:57.369808 27074 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:04:57.370365 27074 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:04:57.378162 27074 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a: Generated new TSK 0
I20260810 21:04:57.378399 27074 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab.
Entry for principal oryx/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab.
I20260810 21:04:57.415707 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44617
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab
--principal=oryx/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:38005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:57.521180 27081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:57.521413 27081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:57.521440 27081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:57.522682 27081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:57.522737 27081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:57.522771 27081 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 21:04:57.522801 27081 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:04:57.524567 27081 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:38005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab
--principal=oryx/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.37.62:44617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:57.524863 27081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:57.525139 27081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:57.531004 27091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:57.531096 27088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:57.531001 27087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:57.531420 27081 server_base.cc:1034] running on GCE node
I20260810 21:04:57.531692 27081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:57.532016 27081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:57.533182 27081 hybrid_clock.cc:648] HybridClock initialized: now 1786395897533167 us; error 33 us; skew 500 ppm
Aug 10 21:04:57 dist-test-slave-jq4t krb5kdc[26908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395897, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:57.535898 27081 init.cc:377] Logged in from keytab as oryx/127.15.37.1@KRBTEST.COM (short username oryx)
I20260810 21:04:57.536360 27081 webserver.cc:460] Webserver started at http://127.15.37.1:39147/ using document root <none> and password file <none>
I20260810 21:04:57.536672 27081 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:57.536744 27081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:57.536895 27081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:57.538005 27081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "dc28edfacd804ad6b20222ea0e5347a3"
format_stamp: "Formatted at 2026-08-10 21:04:57 on dist-test-slave-jq4t"
server_key: "3b551382106c0a1bd2cd329c6e129533"
server_key_iv: "52f938aef7c35a7aba2c2a24141932ef"
server_key_version: "encryptionkey@0"
I20260810 21:04:57.538375 27081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "dc28edfacd804ad6b20222ea0e5347a3"
format_stamp: "Formatted at 2026-08-10 21:04:57 on dist-test-slave-jq4t"
server_key: "3b551382106c0a1bd2cd329c6e129533"
server_key_iv: "52f938aef7c35a7aba2c2a24141932ef"
server_key_version: "encryptionkey@0"
I20260810 21:04:57.539958 27081 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:57.540849 27101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:57.541042 27081 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:57.541154 27081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "dc28edfacd804ad6b20222ea0e5347a3"
format_stamp: "Formatted at 2026-08-10 21:04:57 on dist-test-slave-jq4t"
server_key: "3b551382106c0a1bd2cd329c6e129533"
server_key_iv: "52f938aef7c35a7aba2c2a24141932ef"
server_key_version: "encryptionkey@0"
I20260810 21:04:57.541234 27081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:57.555235 27081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:57.557580 27081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:57.557768 27081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:57.558455 27081 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:57.558521 27081 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:57.558557 27081 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:57.558581 27081 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 21:04:57 dist-test-slave-jq4t krb5kdc[26908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395897, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:57.566280 27081 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:40197
I20260810 21:04:57.566403 27284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:40197 every 8 connection(s)
I20260810 21:04:57.566830 27081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:04:57.569192 27052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.558990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:46281 (local address 127.15.37.62:44617)
0810 21:04:57.559067 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:57.559070 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:57.559297 (+ 227us) server_negotiation.cc:407] Connection header received
0810 21:04:57.559897 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:57.559898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:57.559914 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:57.560011 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:57.560969 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.561842 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.563036 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.563262 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.563358 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.566183 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:57.566185 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:57.566186 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:57.566196 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:57.567899 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.568296 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.568297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.568297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.568350 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.568599 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.568600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.568604 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.568717 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:57.568770 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:57.569048 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 21:04:57.569125 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 21:04:57.569370 27115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.558970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44617 (local address 127.15.37.1:46281)
0810 21:04:57.559153 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:57.559195 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:57.559749 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:57.560103 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:57.560107 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:57.560538 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:57.560854 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.560861 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.561956 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.561957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.562928 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.562931 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.563386 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.563388 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.563542 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.564184 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:57.564196 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:57.566085 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:57.567978 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:57.567984 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:57.567985 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:57.568225 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:57.568392 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:57.568393 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:57.568393 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:57.568543 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:57.568777 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:57.568784 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:57.568915 (+ 131us) client_negotiation.cc:769] Sending connection context
0810 21:04:57.569000 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 21:04:57.569137 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":108,"threads_started":1}
I20260810 21:04:57.569952 27285 heartbeater.cc:347] Connected to a master server at 127.15.37.62:44617
I20260810 21:04:57.570046 27285 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:57.570264 27285 heartbeater.cc:511] Master 127.15.37.62:44617 requested a full tablet report, sending...
I20260810 21:04:57.570853 26978 ts_manager.cc:194] Registered new tserver with Master: dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1:40197)
I20260810 21:04:57.571579 26978 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:46281
I20260810 21:04:57.573060 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 27081
I20260810 21:04:57.573189 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:04:57.573395 15508 external_mini_cluster.cc:1428] Setting key 117f39a83a462031f8e718b64438bf19
I20260810 21:04:57.577265 27052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.571117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:60547 (local address 127.15.37.62:44617)
0810 21:04:57.571162 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:57.571164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:57.571283 (+ 119us) server_negotiation.cc:407] Connection header received
0810 21:04:57.571357 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:57.571358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:57.571369 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:57.571414 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:57.571789 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.572280 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.573060 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.573347 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.573424 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.574392 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:57.574393 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:57.574393 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:57.574414 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:57.576040 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.576472 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.576473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.576503 (+ 30us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.576572 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.576786 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.576786 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.576787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.576892 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:57.576945 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:57.577128 (+ 183us) server_negotiation.cc:299] Negotiation successful
0810 21:04:57.577201 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 21:04:57.577371 27292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.571059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44617 (local address 127.15.37.1:60547)
0810 21:04:57.571204 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:57.571214 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:57.571298 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:57.571428 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:57.571429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:57.571613 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:57.571673 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.571694 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.572380 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.572381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.572966 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.572968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.573422 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.573423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.573499 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.573960 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:57.573964 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:57.574305 (+ 341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:57.576131 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:57.576132 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:57.576132 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:57.576377 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:57.576643 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:57.576644 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:57.576645 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:57.576721 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:57.576955 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:57.576956 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:57.577012 (+ 56us) client_negotiation.cc:769] Sending connection context
0810 21:04:57.577102 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 21:04:57.577230 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":79,"threads_started":1}
WARNING: no policy specified for oryx/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab.
Entry for principal oryx/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab.
I20260810 21:04:57.603646 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44617
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab
--principal=oryx/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:38005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:57.689843 27296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:57.690132 27296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:57.690181 27296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:57.691445 27296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:57.691533 27296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:57.691569 27296 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 21:04:57.691612 27296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:04:57.693413 27296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:38005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab
--principal=oryx/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.37.62:44617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:57.693743 27296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:57.694024 27296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:57.699548 27308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:57.699580 27303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:57.699746 27305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:57.699994 27296 server_base.cc:1034] running on GCE node
I20260810 21:04:57.700224 27296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:57.700443 27296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:57.701663 27296 hybrid_clock.cc:648] HybridClock initialized: now 1786395897701652 us; error 37 us; skew 500 ppm
Aug 10 21:04:57 dist-test-slave-jq4t krb5kdc[26908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395897, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:57.704445 27296 init.cc:377] Logged in from keytab as oryx/127.15.37.2@KRBTEST.COM (short username oryx)
I20260810 21:04:57.704984 27296 webserver.cc:460] Webserver started at http://127.15.37.2:43287/ using document root <none> and password file <none>
I20260810 21:04:57.705237 27296 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:57.705312 27296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:57.705474 27296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:57.706605 27296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "71291d0b0b2440ea899cd877f88750a0"
format_stamp: "Formatted at 2026-08-10 21:04:57 on dist-test-slave-jq4t"
server_key: "4b733a11174d4d73c5458f69b0982ff7"
server_key_iv: "bed6e3585ec999a683114dd19da06a4a"
server_key_version: "encryptionkey@0"
I20260810 21:04:57.706987 27296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "71291d0b0b2440ea899cd877f88750a0"
format_stamp: "Formatted at 2026-08-10 21:04:57 on dist-test-slave-jq4t"
server_key: "4b733a11174d4d73c5458f69b0982ff7"
server_key_iv: "bed6e3585ec999a683114dd19da06a4a"
server_key_version: "encryptionkey@0"
I20260810 21:04:57.708439 27296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 21:04:57.709343 27318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:57.709583 27296 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:57.709685 27296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "71291d0b0b2440ea899cd877f88750a0"
format_stamp: "Formatted at 2026-08-10 21:04:57 on dist-test-slave-jq4t"
server_key: "4b733a11174d4d73c5458f69b0982ff7"
server_key_iv: "bed6e3585ec999a683114dd19da06a4a"
server_key_version: "encryptionkey@0"
I20260810 21:04:57.709744 27296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:57.729938 27296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:57.732088 27296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:57.732208 27296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:57.732841 27296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:57.732894 27296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:57.732928 27296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:57.732950 27296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 21:04:57 dist-test-slave-jq4t krb5kdc[26908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395897, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:57.740512 27296 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:42277
I20260810 21:04:57.740599 27521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:42277 every 8 connection(s)
I20260810 21:04:57.741020 27296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:04:57.743770 27052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.733253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:59213 (local address 127.15.37.62:44617)
0810 21:04:57.733298 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:57.733301 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:57.733552 (+ 251us) server_negotiation.cc:407] Connection header received
0810 21:04:57.734125 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:57.734127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:57.734142 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:57.734195 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:57.734908 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.735439 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.736637 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.736996 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.737091 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.740866 (+ 3775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:57.740868 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:57.740869 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:57.740879 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:57.742401 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.742817 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.742818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.742818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.742873 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.743199 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.743200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.743200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.743317 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:57.743370 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:57.743632 (+ 262us) server_negotiation.cc:299] Negotiation successful
0810 21:04:57.743703 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 21:04:57.743968 27335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.733237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44617 (local address 127.15.37.2:59213)
0810 21:04:57.733420 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:57.733463 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:57.734003 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:57.734267 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:57.734271 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:57.734603 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:57.734801 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.734806 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.735547 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.735548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.736465 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.736468 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.737096 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.737097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.737274 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.737866 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:57.737878 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:57.740739 (+ 2861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:57.742503 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:57.742515 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:57.742517 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:57.742750 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:57.743004 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:57.743005 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:57.743005 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:57.743132 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:57.743377 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:57.743382 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:57.743511 (+ 129us) client_negotiation.cc:769] Sending connection context
0810 21:04:57.743601 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 21:04:57.743741 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260810 21:04:57.744585 27522 heartbeater.cc:347] Connected to a master server at 127.15.37.62:44617
I20260810 21:04:57.744683 27522 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:57.744899 27522 heartbeater.cc:511] Master 127.15.37.62:44617 requested a full tablet report, sending...
I20260810 21:04:57.745379 26978 ts_manager.cc:194] Registered new tserver with Master: 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2:42277)
I20260810 21:04:57.745844 26978 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:59213
I20260810 21:04:57.750383 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 27296
I20260810 21:04:57.750540 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:04:57.750802 15508 external_mini_cluster.cc:1428] Setting key 6159103b3d676759ef6fa5439ab205dd
I20260810 21:04:57.751801 27052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.745863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:42085 (local address 127.15.37.62:44617)
0810 21:04:57.745909 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:57.745911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:57.746026 (+ 115us) server_negotiation.cc:407] Connection header received
0810 21:04:57.746117 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:57.746118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:57.746127 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:57.746187 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:57.746501 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.747096 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.747795 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.747978 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.748036 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.749003 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:57.749005 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:57.749005 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:57.749012 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:57.750392 (+ 1380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.750827 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.750829 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.750829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.750902 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.751193 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.751194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.751194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.751350 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:57.751438 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:57.751613 (+ 175us) server_negotiation.cc:299] Negotiation successful
0810 21:04:57.751702 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 21:04:57.751817 27530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.745763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44617 (local address 127.15.37.2:42085)
0810 21:04:57.745960 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:57.745972 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:57.746055 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:57.746172 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:57.746173 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:57.746358 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:57.746421 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.746422 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.747193 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.747194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.747721 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.747723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.748044 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.748045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.748096 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.748602 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:57.748607 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:57.748915 (+ 308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:57.750505 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:57.750506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:57.750507 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:57.750739 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:57.750980 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:57.750981 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:57.750981 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:57.751077 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:57.751432 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:57.751433 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:57.751487 (+ 54us) client_negotiation.cc:769] Sending connection context
0810 21:04:57.751587 (+ 100us) client_negotiation.cc:240] Negotiation successful
0810 21:04:57.751704 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":87,"threads_started":1}
WARNING: no policy specified for oryx/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab.
Entry for principal oryx/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab.
I20260810 21:04:57.779772 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44617
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab
--principal=oryx/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:38005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:04:57.869067 27533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:04:57.869325 27533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:04:57.869364 27533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:04:57.870607 27533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:04:57.870675 27533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:04:57.870708 27533 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 21:04:57.870750 27533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:04:57.872363 27533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:38005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab
--principal=oryx/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.15.37.62:44617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:04:57.872704 27533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:04:57.872967 27533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:04:57.878724 27542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:04:57.878728 27546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:57.878883 27533 server_base.cc:1034] running on GCE node
W20260810 21:04:57.879061 27551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:04:57.879352 27533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:04:57.879642 27533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:04:57.880841 27533 hybrid_clock.cc:648] HybridClock initialized: now 1786395897880824 us; error 39 us; skew 500 ppm
Aug 10 21:04:57 dist-test-slave-jq4t krb5kdc[26908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395897, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:04:57.883931 27533 init.cc:377] Logged in from keytab as oryx/127.15.37.3@KRBTEST.COM (short username oryx)
I20260810 21:04:57.884451 27533 webserver.cc:460] Webserver started at http://127.15.37.3:37023/ using document root <none> and password file <none>
I20260810 21:04:57.884728 27533 fs_manager.cc:359] Metadata directory not provided
I20260810 21:04:57.884776 27533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:04:57.884874 27533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:04:57.885996 27533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "77b72eae3a9e4e51875d50ee9e15ddab"
format_stamp: "Formatted at 2026-08-10 21:04:57 on dist-test-slave-jq4t"
server_key: "7c1e06d9a81249173663e98053523344"
server_key_iv: "1d011b6d610b16e2c8f5b9617242ff48"
server_key_version: "encryptionkey@0"
I20260810 21:04:57.886323 27533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "77b72eae3a9e4e51875d50ee9e15ddab"
format_stamp: "Formatted at 2026-08-10 21:04:57 on dist-test-slave-jq4t"
server_key: "7c1e06d9a81249173663e98053523344"
server_key_iv: "1d011b6d610b16e2c8f5b9617242ff48"
server_key_version: "encryptionkey@0"
I20260810 21:04:57.887739 27533 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:04:57.888577 27562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:57.888769 27533 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:57.888855 27533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "77b72eae3a9e4e51875d50ee9e15ddab"
format_stamp: "Formatted at 2026-08-10 21:04:57 on dist-test-slave-jq4t"
server_key: "7c1e06d9a81249173663e98053523344"
server_key_iv: "1d011b6d610b16e2c8f5b9617242ff48"
server_key_version: "encryptionkey@0"
I20260810 21:04:57.888940 27533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:04:57.899837 27533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:04:57.902166 27533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:04:57.902297 27533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:04:57.902834 27533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:04:57.902885 27533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:57.902908 27533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:04:57.902921 27533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:57.911105 27533 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:45571
I20260810 21:04:57.911197 27773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:45571 every 8 connection(s)
Aug 10 21:04:57 dist-test-slave-jq4t krb5kdc[26908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395897, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:57.911576 27533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:04:57.915033 27052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.903400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:41337 (local address 127.15.37.62:44617)
0810 21:04:57.903482 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:57.903484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:57.903730 (+ 246us) server_negotiation.cc:407] Connection header received
0810 21:04:57.904564 (+ 834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:57.904566 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:57.904580 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:57.904668 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:57.905728 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.906607 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.908402 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.908764 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.908843 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.912029 (+ 3186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:57.912031 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:57.912032 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:57.912041 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:57.913540 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.913992 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.913993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.913994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.914059 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.914332 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.914333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.914334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.914468 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:57.914540 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:57.914840 (+ 300us) server_negotiation.cc:299] Negotiation successful
0810 21:04:57.914940 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 21:04:57.915236 27582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.903356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44617 (local address 127.15.37.3:41337)
0810 21:04:57.903568 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:57.903623 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:57.904392 (+ 769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:57.904783 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:57.904789 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:57.905258 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:57.905614 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.905620 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.906726 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.906728 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.908276 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.908281 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.908861 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.908862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.909040 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.909794 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:57.909808 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:57.911875 (+ 2067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:57.913651 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:57.913658 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:57.913661 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:57.913902 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:57.914134 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:57.914135 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:57.914135 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:57.914255 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:57.914542 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:57.914550 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:57.914702 (+ 152us) client_negotiation.cc:769] Sending connection context
0810 21:04:57.914816 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 21:04:57.914993 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":104,"threads_started":1}
I20260810 21:04:57.915778 27776 heartbeater.cc:347] Connected to a master server at 127.15.37.62:44617
I20260810 21:04:57.915871 27776 heartbeater.cc:464] Registering TS with master...
I20260810 21:04:57.916108 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 27533
I20260810 21:04:57.916226 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:04:57.916528 15508 external_mini_cluster.cc:1428] Setting key 56342cf38238633d1c49c3aa7978196e
I20260810 21:04:57.916868 27776 heartbeater.cc:511] Master 127.15.37.62:44617 requested a full tablet report, sending...
I20260810 21:04:57.917321 26978 ts_manager.cc:194] Registered new tserver with Master: 77b72eae3a9e4e51875d50ee9e15ddab (127.15.37.3:45571)
I20260810 21:04:57.917780 26978 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:41337
I20260810 21:04:57.922876 27052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.917188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:51831 (local address 127.15.37.62:44617)
0810 21:04:57.917226 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:57.917228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:57.917464 (+ 236us) server_negotiation.cc:407] Connection header received
0810 21:04:57.917510 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:57.917511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:57.917522 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:57.917577 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:57.917870 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.918582 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.919278 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.919471 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.919528 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.920423 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:57.920424 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:57.920424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:57.920431 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:57.921949 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.922263 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.922264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.922264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.922329 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.922481 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.922481 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.922482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.922585 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:57.922633 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:57.922746 (+ 113us) server_negotiation.cc:299] Negotiation successful
0810 21:04:57.922808 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260810 21:04:57.922886 27788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.917078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44617 (local address 127.15.37.3:51831)
0810 21:04:57.917381 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:57.917394 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:57.917458 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:57.917579 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:57.917579 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:57.917743 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:57.917797 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.917799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.918684 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.918685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.919200 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.919202 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.919545 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.919545 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.919594 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.920050 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:57.920055 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:57.920343 (+ 288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:57.922033 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:57.922034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:57.922035 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:57.922198 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:57.922389 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:57.922390 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:57.922390 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:57.922443 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:57.922637 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:57.922638 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:57.922681 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 21:04:57.922732 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 21:04:57.922819 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":74,"threads_started":1}
I20260810 21:04:57.928467 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 21:04:57 dist-test-slave-jq4t krb5kdc[26908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395897, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 21:04:57 dist-test-slave-jq4t krb5kdc[26908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:04:57 dist-test-slave-jq4t krb5kdc[26908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
W20260810 21:04:57.952621 27052 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:04:57.946802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44126 (local address 127.15.37.62:44617)
0810 21:04:57.946867 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:57.946869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:57.946879 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:04:57.946917 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:57.946917 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:57.946928 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:57.946982 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:57.947581 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.948107 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.948924 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.949122 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.949185 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.952525 (+ 3340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44126: BlockingRecv error: recv got EOF from 127.0.0.1:44126 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 10 21:04:57 dist-test-slave-jq4t krb5kdc[26908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395897, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:57.961647 27052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.953656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44142 (local address 127.15.37.62:44617)
0810 21:04:57.953729 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:57.953731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:57.953761 (+ 30us) server_negotiation.cc:407] Connection header received
0810 21:04:57.953831 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:57.953831 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:57.953841 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:57.953890 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:57.954467 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.954981 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.955758 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.955941 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.955996 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.958406 (+ 2410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:57.958408 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:57.958409 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:57.958417 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:57.960183 (+ 1766us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.960661 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.960663 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.960663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.960730 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:57.960959 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:57.960960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:57.960961 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:57.961155 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:57.961265 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:57.961443 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 21:04:57.961535 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 21:04:57.963338 26978 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44142:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:57.965127 26978 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:57.972462 27813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.967623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:45571 (local address 127.0.0.1:41506)
0810 21:04:57.968071 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:57.968080 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:57.968127 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:57.968437 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:57.968438 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:57.968439 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:57.968587 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.968590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.969998 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.969999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.971372 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.971375 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.972089 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.972090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.972182 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.972196 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 21:04:57.972305 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 21:04:57.972367 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"mutex_wait_us":74,"thread_start_us":96,"threads_started":1}
I20260810 21:04:57.972497 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.967751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41506 (local address 127.15.37.3:45571)
0810 21:04:57.968028 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:57.968032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:57.968213 (+ 181us) server_negotiation.cc:407] Connection header received
0810 21:04:57.968257 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:57.968261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:57.968279 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:57.968370 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:57.968680 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.969895 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.971482 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.971983 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.972074 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.972156 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:57.972326 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 21:04:57.972369 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":115,"threads_started":1}
I20260810 21:04:57.972779 27811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.967843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:40197 (local address 127.0.0.1:34886)
0810 21:04:57.968551 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:57.968562 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:57.968615 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:57.968868 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:57.968869 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:57.968872 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:57.968924 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.968926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.970129 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.970130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.971126 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.971129 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.972547 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.972548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.972610 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.972614 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:57.972661 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 21:04:57.972704 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":75,"threads_started":1}
I20260810 21:04:57.973007 27823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.968097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34886 (local address 127.15.37.1:40197)
0810 21:04:57.968460 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:57.968465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:57.968680 (+ 215us) server_negotiation.cc:407] Connection header received
0810 21:04:57.968729 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:57.968731 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:57.968748 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:57.968828 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:57.969016 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.970042 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.971224 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.971979 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.972079 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.972156 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:57.972855 (+ 699us) server_negotiation.cc:299] Negotiation successful
0810 21:04:57.972903 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":83,"threads_started":1}
I20260810 21:04:57.973615 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.967620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:42277 (local address 127.0.0.1:43862)
0810 21:04:57.967973 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:57.968021 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:57.968118 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:57.968419 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:57.968423 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:57.968425 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:57.970013 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.970017 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.971425 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.971426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.972389 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:57.972392 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.973350 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.973352 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:57.973413 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.973418 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:04:57.973479 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 21:04:57.973526 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":3,"thread_start_us":78,"threads_started":1}
I20260810 21:04:57.973639 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:57.967730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43862 (local address 127.15.37.2:42277)
0810 21:04:57.967908 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:57.967914 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:57.968097 (+ 183us) server_negotiation.cc:407] Connection header received
0810 21:04:57.968217 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:57.968219 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:57.968236 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:57.968329 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:57.970151 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.971332 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.972510 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:57.973277 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:57.973350 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:57.973423 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:57.973498 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 21:04:57.973540 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":85,"threads_started":1}
I20260810 21:04:57.973771 27655 tablet_service.cc:1467] Processing CreateTablet for tablet 14f55fcefffd42d5b36980d5513e2e12 (DEFAULT_TABLE table=test-table [id=ad3249110cad4f3e87f7606df3139e37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:57.974153 27655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14f55fcefffd42d5b36980d5513e2e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:57.974208 27406 tablet_service.cc:1467] Processing CreateTablet for tablet 14f55fcefffd42d5b36980d5513e2e12 (DEFAULT_TABLE table=test-table [id=ad3249110cad4f3e87f7606df3139e37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:57.974478 27406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14f55fcefffd42d5b36980d5513e2e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:57.976960 27185 tablet_service.cc:1467] Processing CreateTablet for tablet 14f55fcefffd42d5b36980d5513e2e12 (DEFAULT_TABLE table=test-table [id=ad3249110cad4f3e87f7606df3139e37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:57.977353 27185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14f55fcefffd42d5b36980d5513e2e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:57.977366 27826 tablet_bootstrap.cc:492] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab: Bootstrap starting.
I20260810 21:04:57.977875 27827 tablet_bootstrap.cc:492] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0: Bootstrap starting.
I20260810 21:04:57.978240 27826 tablet_bootstrap.cc:654] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:57.978543 27827 tablet_bootstrap.cc:654] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:57.978585 27826 log.cc:824] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:57.978883 27827 log.cc:824] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:57.979578 27826 tablet_bootstrap.cc:492] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab: No bootstrap required, opened a new log
I20260810 21:04:57.979664 27826 ts_tablet_manager.cc:1397] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:04:57.979876 27827 tablet_bootstrap.cc:492] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0: No bootstrap required, opened a new log
I20260810 21:04:57.979951 27827 ts_tablet_manager.cc:1397] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:04:57.981279 27831 tablet_bootstrap.cc:492] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3: Bootstrap starting.
I20260810 21:04:57.981895 27831 tablet_bootstrap.cc:654] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:57.981896 27826 raft_consensus.cc:348] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } }
I20260810 21:04:57.982090 27826 raft_consensus.cc:374] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:57.982013 27827 raft_consensus.cc:348] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } }
I20260810 21:04:57.982137 27826 raft_consensus.cc:729] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77b72eae3a9e4e51875d50ee9e15ddab, State: Initialized, Role: FOLLOWER
I20260810 21:04:57.982152 27827 raft_consensus.cc:374] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:57.982184 27827 raft_consensus.cc:729] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71291d0b0b2440ea899cd877f88750a0, State: Initialized, Role: FOLLOWER
I20260810 21:04:57.982295 27831 log.cc:824] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3: Log is configured to *not* fsync() on all Append() calls
I20260810 21:04:57.982296 27827 consensus_queue.cc:260] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } }
I20260810 21:04:57.982296 27826 consensus_queue.cc:260] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } }
I20260810 21:04:57.982591 27827 ts_tablet_manager.cc:1428] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:04:57.982591 27826 ts_tablet_manager.cc:1428] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:04:57.982625 27522 heartbeater.cc:503] Master 127.15.37.62:44617 was elected leader, sending a full tablet report...
I20260810 21:04:57.982736 27776 heartbeater.cc:503] Master 127.15.37.62:44617 was elected leader, sending a full tablet report...
I20260810 21:04:57.983304 27831 tablet_bootstrap.cc:492] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3: No bootstrap required, opened a new log
I20260810 21:04:57.983381 27831 ts_tablet_manager.cc:1397] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:04:57.985041 27831 raft_consensus.cc:348] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } }
I20260810 21:04:57.985172 27831 raft_consensus.cc:374] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:57.985194 27831 raft_consensus.cc:729] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc28edfacd804ad6b20222ea0e5347a3, State: Initialized, Role: FOLLOWER
I20260810 21:04:57.985345 27831 consensus_queue.cc:260] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } }
I20260810 21:04:57.985641 27831 ts_tablet_manager.cc:1428] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 21:04:57.985709 27285 heartbeater.cc:503] Master 127.15.37.62:44617 was elected leader, sending a full tablet report...
W20260810 21:04:57.991969 27524 tablet.cc:2369] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:04:58.067696 27286 tablet.cc:2369] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:04:58.122115 27835 raft_consensus.cc:482] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:58.122280 27835 raft_consensus.cc:504] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } }
I20260810 21:04:58.122750 27835 leader_election.cc:288] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2:42277), 77b72eae3a9e4e51875d50ee9e15ddab (127.15.37.3:45571)
I20260810 21:04:58.126001 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.123207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:58965 (local address 127.15.37.2:42277)
0810 21:04:58.123258 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.123261 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.123318 (+ 57us) server_negotiation.cc:407] Connection header received
0810 21:04:58.123385 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.123386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.123399 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.123462 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:58.123657 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.124109 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.125245 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.125612 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.125664 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.125674 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.125871 (+ 197us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.125915 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 21:04:58.126057 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.123078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:39975 (local address 127.15.37.3:45571)
0810 21:04:58.123158 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.123160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.123174 (+ 14us) server_negotiation.cc:407] Connection header received
0810 21:04:58.123295 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.123296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.123310 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.123372 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:58.123579 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.124109 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.125232 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.125634 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.125723 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.125732 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.125958 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.125998 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 21:04:58.126055 27837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.123094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:42277 (local address 127.15.37.1:58965)
0810 21:04:58.123228 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:58.123240 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:58.123314 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:58.123484 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:58.123485 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:58.123487 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:58.123579 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.123580 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.124203 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.124204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.125131 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.125134 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.125687 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.125688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.125769 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.125773 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:58.125849 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 21:04:58.125933 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":22,"thread_start_us":70,"threads_started":1}
I20260810 21:04:58.126068 27836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.122972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:45571 (local address 127.15.37.1:39975)
0810 21:04:58.123095 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:58.123111 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:58.123188 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:58.123387 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:58.123388 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:58.123390 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:58.123483 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.123486 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.124200 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.124201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.125133 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.125136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.125738 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.125739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.125794 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.125797 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:04:58.125872 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 21:04:58.125915 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":37,"thread_start_us":74,"threads_started":1}
I20260810 21:04:58.126489 27692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f55fcefffd42d5b36980d5513e2e12" candidate_uuid: "dc28edfacd804ad6b20222ea0e5347a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" is_pre_election: true
I20260810 21:04:58.126523 27440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f55fcefffd42d5b36980d5513e2e12" candidate_uuid: "dc28edfacd804ad6b20222ea0e5347a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71291d0b0b2440ea899cd877f88750a0" is_pre_election: true
I20260810 21:04:58.126684 27440 raft_consensus.cc:2454] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc28edfacd804ad6b20222ea0e5347a3 in term 0.
I20260810 21:04:58.126688 27692 raft_consensus.cc:2454] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc28edfacd804ad6b20222ea0e5347a3 in term 0.
I20260810 21:04:58.126952 27106 leader_election.cc:302] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77b72eae3a9e4e51875d50ee9e15ddab, dc28edfacd804ad6b20222ea0e5347a3; no voters:
I20260810 21:04:58.127107 27835 raft_consensus.cc:2781] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:58.127182 27835 raft_consensus.cc:482] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:58.127202 27835 raft_consensus.cc:3037] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.128007 27835 raft_consensus.cc:504] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } }
I20260810 21:04:58.128177 27835 leader_election.cc:288] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [CANDIDATE]: Term 1 election: Requested vote from peers 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2:42277), 77b72eae3a9e4e51875d50ee9e15ddab (127.15.37.3:45571)
I20260810 21:04:58.128356 27692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f55fcefffd42d5b36980d5513e2e12" candidate_uuid: "dc28edfacd804ad6b20222ea0e5347a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77b72eae3a9e4e51875d50ee9e15ddab"
I20260810 21:04:58.128439 27440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f55fcefffd42d5b36980d5513e2e12" candidate_uuid: "dc28edfacd804ad6b20222ea0e5347a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71291d0b0b2440ea899cd877f88750a0"
I20260810 21:04:58.128473 27692 raft_consensus.cc:3037] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.128577 27440 raft_consensus.cc:3037] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.129313 27440 raft_consensus.cc:2454] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc28edfacd804ad6b20222ea0e5347a3 in term 1.
I20260810 21:04:58.129314 27692 raft_consensus.cc:2454] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc28edfacd804ad6b20222ea0e5347a3 in term 1.
I20260810 21:04:58.129518 27107 leader_election.cc:302] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71291d0b0b2440ea899cd877f88750a0, dc28edfacd804ad6b20222ea0e5347a3; no voters:
I20260810 21:04:58.129639 27835 raft_consensus.cc:2781] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:58.129796 27835 raft_consensus.cc:686] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 LEADER]: Becoming Leader. State: Replica: dc28edfacd804ad6b20222ea0e5347a3, State: Running, Role: LEADER
I20260810 21:04:58.129922 27835 consensus_queue.cc:237] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } }
I20260810 21:04:58.130878 26978 catalog_manager.cc:5495] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1). New cstate: current_term: 1 leader_uuid: "dc28edfacd804ad6b20222ea0e5347a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } health_report { overall_health: HEALTHY } } }
I20260810 21:04:58.155928 27823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.153039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34902 (local address 127.15.37.1:40197)
0810 21:04:58.153104 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.153106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.153115 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:04:58.153168 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.153169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.153190 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.153254 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:58.153382 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.154052 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.154999 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.155195 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.155251 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.155554 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:58.155677 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:58.155755 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.155831 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.155853 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 21:04:58.158049 27692 raft_consensus.cc:1261] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Refusing update from remote peer dc28edfacd804ad6b20222ea0e5347a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:58.158078 27440 raft_consensus.cc:1261] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Refusing update from remote peer dc28edfacd804ad6b20222ea0e5347a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:58.158463 27835 consensus_queue.cc:1035] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:58.158602 27838 consensus_queue.cc:1035] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:58.161226 27842 mvcc.cc:205] Tried to move back new op lower bound from 7317077598852284416 to 7317077598740844544. Current Snapshot: MvccSnapshot[applied={T|T < 7317077598852284416}]
I20260810 21:04:58.164456 26977 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:58.164609 26977 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:58.165505 26977 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a: Sending DeleteTablet for 3 replicas of tablet 14f55fcefffd42d5b36980d5513e2e12
I20260810 21:04:58.166029 27185 tablet_service.cc:1514] Processing DeleteTablet for tablet 14f55fcefffd42d5b36980d5513e2e12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:58 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34886
I20260810 21:04:58.166047 27406 tablet_service.cc:1514] Processing DeleteTablet for tablet 14f55fcefffd42d5b36980d5513e2e12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:58 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:43862
I20260810 21:04:58.166301 27858 tablet_replica.cc:330] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3: stopping tablet replica
I20260810 21:04:58.166319 27655 tablet_service.cc:1514] Processing DeleteTablet for tablet 14f55fcefffd42d5b36980d5513e2e12 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:58 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:41506
I20260810 21:04:58.166277 26977 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44142:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 21:04:58.166414 27858 raft_consensus.cc:2229] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 LEADER]: Raft consensus shutting down.
W20260810 21:04:58.166432 26977 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:58.166569 27858 raft_consensus.cc:2258] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:58.167116 27858 ts_tablet_manager.cc:1905] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:58.167801 27861 tablet_replica.cc:330] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab: stopping tablet replica
I20260810 21:04:58.167989 27861 raft_consensus.cc:2229] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:58.168064 27406 tablet_service.cc:1467] Processing CreateTablet for tablet 57cc5868823d48d7a093a1dd24d46022 (DEFAULT_TABLE table=test-table [id=4017a6c2b5f14180a4064a6d65fb6c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:58.168212 27406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57cc5868823d48d7a093a1dd24d46022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:58.168431 27861 raft_consensus.cc:2258] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:58.168644 27860 tablet_replica.cc:330] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0: stopping tablet replica
I20260810 21:04:58.168798 27860 raft_consensus.cc:2229] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:58.169098 27858 ts_tablet_manager.cc:1918] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:58.169189 27858 log.cc:1196] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/wal/wals/14f55fcefffd42d5b36980d5513e2e12
I20260810 21:04:58.169327 27860 raft_consensus.cc:2258] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:58.169497 27858 ts_tablet_manager.cc:1939] T 14f55fcefffd42d5b36980d5513e2e12 P dc28edfacd804ad6b20222ea0e5347a3: Deleting consensus metadata
I20260810 21:04:58.169636 27827 tablet_bootstrap.cc:492] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0: Bootstrap starting.
I20260810 21:04:58.170097 27861 ts_tablet_manager.cc:1905] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:58.170115 27827 tablet_bootstrap.cc:654] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:58.170250 27655 tablet_service.cc:1467] Processing CreateTablet for tablet 57cc5868823d48d7a093a1dd24d46022 (DEFAULT_TABLE table=test-table [id=4017a6c2b5f14180a4064a6d65fb6c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:58.170367 27655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57cc5868823d48d7a093a1dd24d46022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:58.170967 27860 ts_tablet_manager.cc:1905] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:58.171787 27826 tablet_bootstrap.cc:492] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab: Bootstrap starting.
I20260810 21:04:58.172014 27185 tablet_service.cc:1467] Processing CreateTablet for tablet 57cc5868823d48d7a093a1dd24d46022 (DEFAULT_TABLE table=test-table [id=4017a6c2b5f14180a4064a6d65fb6c7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:58.172142 27185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57cc5868823d48d7a093a1dd24d46022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:58.172242 27826 tablet_bootstrap.cc:654] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:58.172912 27860 ts_tablet_manager.cc:1918] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:58.172958 26955 catalog_manager.cc:4841] TS dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1:40197): tablet 14f55fcefffd42d5b36980d5513e2e12 (table test-table [id=ad3249110cad4f3e87f7606df3139e37]) successfully deleted
I20260810 21:04:58.173094 27860 log.cc:1196] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/14f55fcefffd42d5b36980d5513e2e12
I20260810 21:04:58.173450 27860 ts_tablet_manager.cc:1939] T 14f55fcefffd42d5b36980d5513e2e12 P 71291d0b0b2440ea899cd877f88750a0: Deleting consensus metadata
I20260810 21:04:58.173448 27831 tablet_bootstrap.cc:492] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3: Bootstrap starting.
I20260810 21:04:58.173863 27831 tablet_bootstrap.cc:654] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:58.173995 26956 catalog_manager.cc:4841] TS 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2:42277): tablet 14f55fcefffd42d5b36980d5513e2e12 (table test-table [id=ad3249110cad4f3e87f7606df3139e37]) successfully deleted
I20260810 21:04:58.174633 27831 tablet_bootstrap.cc:492] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3: No bootstrap required, opened a new log
I20260810 21:04:58.174691 27831 ts_tablet_manager.cc:1397] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:58.174817 27861 ts_tablet_manager.cc:1918] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:58.174835 27831 raft_consensus.cc:348] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.174903 27831 raft_consensus.cc:374] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:58.174932 27831 raft_consensus.cc:729] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc28edfacd804ad6b20222ea0e5347a3, State: Initialized, Role: FOLLOWER
I20260810 21:04:58.174930 27861 log.cc:1196] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/14f55fcefffd42d5b36980d5513e2e12
I20260810 21:04:58.174976 27831 consensus_queue.cc:260] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.175100 27831 ts_tablet_manager.cc:1428] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 21:04:58.175205 27861 ts_tablet_manager.cc:1939] T 14f55fcefffd42d5b36980d5513e2e12 P 77b72eae3a9e4e51875d50ee9e15ddab: Deleting consensus metadata
I20260810 21:04:58.175709 26955 catalog_manager.cc:4841] TS 77b72eae3a9e4e51875d50ee9e15ddab (127.15.37.3:45571): tablet 14f55fcefffd42d5b36980d5513e2e12 (table test-table [id=ad3249110cad4f3e87f7606df3139e37]) successfully deleted
I20260810 21:04:58.175848 27826 tablet_bootstrap.cc:492] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab: No bootstrap required, opened a new log
I20260810 21:04:58.175896 27826 ts_tablet_manager.cc:1397] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260810 21:04:58.176045 27826 raft_consensus.cc:348] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.176129 27826 raft_consensus.cc:374] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:58.176159 27826 raft_consensus.cc:729] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77b72eae3a9e4e51875d50ee9e15ddab, State: Initialized, Role: FOLLOWER
I20260810 21:04:58.176201 27826 consensus_queue.cc:260] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.176301 27826 ts_tablet_manager.cc:1428] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 21:04:58.176621 27827 tablet_bootstrap.cc:492] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0: No bootstrap required, opened a new log
I20260810 21:04:58.176672 27827 ts_tablet_manager.cc:1397] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260810 21:04:58.176826 27827 raft_consensus.cc:348] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.176911 27827 raft_consensus.cc:374] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:58.176934 27827 raft_consensus.cc:729] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71291d0b0b2440ea899cd877f88750a0, State: Initialized, Role: FOLLOWER
I20260810 21:04:58.177002 27827 consensus_queue.cc:260] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.177099 27827 ts_tablet_manager.cc:1428] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:58.406870 27832 raft_consensus.cc:482] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:58.406998 27832 raft_consensus.cc:504] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.407424 27832 leader_election.cc:288] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1:40197), 77b72eae3a9e4e51875d50ee9e15ddab (127.15.37.3:45571)
I20260810 21:04:58.411767 27823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.407705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:43493 (local address 127.15.37.1:40197)
0810 21:04:58.407784 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.407786 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.407853 (+ 67us) server_negotiation.cc:407] Connection header received
0810 21:04:58.407935 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.407936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.407948 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.408023 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:58.408243 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.409078 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.410671 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.411284 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.411377 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.411388 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.411637 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.411693 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 21:04:58.411754 27867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.407623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:40197 (local address 127.15.37.2:43493)
0810 21:04:58.407777 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:58.407789 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:58.407864 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:58.408062 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:58.408063 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:58.408067 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:58.408165 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.408167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.409186 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.409187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.410545 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.410548 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.411415 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.411416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.411507 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.411512 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:04:58.411569 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 21:04:58.411652 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":7,"thread_start_us":97,"threads_started":1}
I20260810 21:04:58.411796 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.408023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:41037 (local address 127.15.37.3:45571)
0810 21:04:58.408097 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.408099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.408154 (+ 55us) server_negotiation.cc:407] Connection header received
0810 21:04:58.408237 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.408238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.408247 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.408309 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:58.408456 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.409175 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.410670 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.411283 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.411374 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.411387 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.411671 (+ 284us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.411721 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 21:04:58.412139 27868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.407847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:45571 (local address 127.15.37.2:41037)
0810 21:04:58.408095 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:58.408107 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:58.408167 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:58.408332 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:58.408333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:58.408334 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:58.408384 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.408385 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.409256 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.409257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.410545 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.410548 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.411450 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.411452 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.411525 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.411529 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:58.411658 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 21:04:58.411731 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":59,"thread_start_us":51,"threads_started":1}
I20260810 21:04:58.412273 27212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57cc5868823d48d7a093a1dd24d46022" candidate_uuid: "71291d0b0b2440ea899cd877f88750a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc28edfacd804ad6b20222ea0e5347a3" is_pre_election: true
I20260810 21:04:58.412452 27212 raft_consensus.cc:2454] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71291d0b0b2440ea899cd877f88750a0 in term 0.
I20260810 21:04:58.412571 27692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57cc5868823d48d7a093a1dd24d46022" candidate_uuid: "71291d0b0b2440ea899cd877f88750a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" is_pre_election: true
W20260810 21:04:58.412627 27777 tablet.cc:2369] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:04:58.412688 27692 raft_consensus.cc:2454] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71291d0b0b2440ea899cd877f88750a0 in term 0.
I20260810 21:04:58.412714 27321 leader_election.cc:302] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71291d0b0b2440ea899cd877f88750a0, dc28edfacd804ad6b20222ea0e5347a3; no voters:
I20260810 21:04:58.412860 27832 raft_consensus.cc:2781] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:58.412920 27832 raft_consensus.cc:482] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:58.412946 27832 raft_consensus.cc:3037] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.413673 27832 raft_consensus.cc:504] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.413831 27832 leader_election.cc:288] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [CANDIDATE]: Term 1 election: Requested vote from peers dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1:40197), 77b72eae3a9e4e51875d50ee9e15ddab (127.15.37.3:45571)
I20260810 21:04:58.414069 27212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57cc5868823d48d7a093a1dd24d46022" candidate_uuid: "71291d0b0b2440ea899cd877f88750a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc28edfacd804ad6b20222ea0e5347a3"
I20260810 21:04:58.414068 27692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57cc5868823d48d7a093a1dd24d46022" candidate_uuid: "71291d0b0b2440ea899cd877f88750a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77b72eae3a9e4e51875d50ee9e15ddab"
I20260810 21:04:58.414155 27692 raft_consensus.cc:3037] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.414155 27212 raft_consensus.cc:3037] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.414927 27692 raft_consensus.cc:2454] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71291d0b0b2440ea899cd877f88750a0 in term 1.
I20260810 21:04:58.415112 27212 raft_consensus.cc:2454] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71291d0b0b2440ea899cd877f88750a0 in term 1.
I20260810 21:04:58.415143 27321 leader_election.cc:302] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71291d0b0b2440ea899cd877f88750a0, 77b72eae3a9e4e51875d50ee9e15ddab; no voters:
I20260810 21:04:58.415325 27832 raft_consensus.cc:2781] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:58.415499 27832 raft_consensus.cc:686] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [term 1 LEADER]: Becoming Leader. State: Replica: 71291d0b0b2440ea899cd877f88750a0, State: Running, Role: LEADER
I20260810 21:04:58.415560 27832 consensus_queue.cc:237] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.416292 26977 catalog_manager.cc:5495] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2). New cstate: current_term: 1 leader_uuid: "71291d0b0b2440ea899cd877f88750a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } health_report { overall_health: UNKNOWN } } }
Aug 10 21:04:58 dist-test-slave-jq4t krb5kdc[26908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395897, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.62@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:58.484565 27884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.477250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44617 (local address 127.0.0.1:44156)
0810 21:04:58.477396 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:58.477409 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:58.477499 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:58.477666 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:58.477667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:58.478016 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:04:58.478068 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.478071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.478778 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.478779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.479340 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.479342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.479725 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.479725 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.479769 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.480344 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:04:58.480348 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:04:58.481900 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:04:58.483510 (+ 1610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:58.483518 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:58.483521 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:58.483735 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:58.483923 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:04:58.483924 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:04:58.483924 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:04:58.483983 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:04:58.484209 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:04:58.484215 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:04:58.484260 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 21:04:58.484313 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 21:04:58.484412 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":51,"threads_started":1}
I20260810 21:04:58.484687 27886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.477349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44156 (local address 127.15.37.62:44617)
0810 21:04:58.477514 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.477516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.477545 (+ 29us) server_negotiation.cc:407] Connection header received
0810 21:04:58.477571 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.477571 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.477582 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.477638 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:58.478165 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.478697 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.479434 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.479650 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.479711 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.482003 (+ 2292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:58.482005 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:58.482006 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:58.482013 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:58.483430 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:58.483804 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:58.483805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:58.483805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:58.483862 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:58.484038 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:58.484039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:58.484039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:58.484152 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:58.484204 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.484347 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.484469 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":143,"thread_start_us":93,"threads_started":1}
I20260810 21:04:58.486981 26977 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:44156:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 21:04:58.487179 26977 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:58.488796 27406 tablet_service.cc:1467] Processing CreateTablet for tablet 63e5571eda50424b890322f6f53161f1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3aa9d5de2f654334a004f9a3dfedd630]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 21:04:58.488809 27185 tablet_service.cc:1467] Processing CreateTablet for tablet 63e5571eda50424b890322f6f53161f1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3aa9d5de2f654334a004f9a3dfedd630]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 21:04:58.488889 27655 tablet_service.cc:1467] Processing CreateTablet for tablet 63e5571eda50424b890322f6f53161f1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3aa9d5de2f654334a004f9a3dfedd630]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 21:04:58.489003 27406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63e5571eda50424b890322f6f53161f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:58.489010 27185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63e5571eda50424b890322f6f53161f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:58.489044 27655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63e5571eda50424b890322f6f53161f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:58.490233 27827 tablet_bootstrap.cc:492] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0: Bootstrap starting.
I20260810 21:04:58.490743 27827 tablet_bootstrap.cc:654] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:58.490787 27826 tablet_bootstrap.cc:492] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab: Bootstrap starting.
I20260810 21:04:58.490795 27831 tablet_bootstrap.cc:492] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3: Bootstrap starting.
I20260810 21:04:58.491159 27831 tablet_bootstrap.cc:654] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:58.491261 27826 tablet_bootstrap.cc:654] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:58.491881 27827 tablet_bootstrap.cc:492] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0: No bootstrap required, opened a new log
I20260810 21:04:58.491896 27831 tablet_bootstrap.cc:492] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3: No bootstrap required, opened a new log
I20260810 21:04:58.491943 27827 ts_tablet_manager.cc:1397] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 21:04:58.491969 27831 ts_tablet_manager.cc:1397] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:58.492023 27826 tablet_bootstrap.cc:492] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab: No bootstrap required, opened a new log
I20260810 21:04:58.492084 27826 ts_tablet_manager.cc:1397] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:58.492098 27827 raft_consensus.cc:348] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.492113 27831 raft_consensus.cc:348] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.492188 27831 raft_consensus.cc:374] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:58.492187 27827 raft_consensus.cc:374] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:58.492218 27831 raft_consensus.cc:729] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc28edfacd804ad6b20222ea0e5347a3, State: Initialized, Role: FOLLOWER
I20260810 21:04:58.492233 27827 raft_consensus.cc:729] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71291d0b0b2440ea899cd877f88750a0, State: Initialized, Role: FOLLOWER
I20260810 21:04:58.492219 27826 raft_consensus.cc:348] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.492261 27831 consensus_queue.cc:260] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.492287 27826 raft_consensus.cc:374] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:58.492308 27826 raft_consensus.cc:729] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77b72eae3a9e4e51875d50ee9e15ddab, State: Initialized, Role: FOLLOWER
I20260810 21:04:58.492278 27827 consensus_queue.cc:260] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.492348 27831 ts_tablet_manager.cc:1428] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 21:04:58.492350 27826 consensus_queue.cc:260] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.492380 27827 ts_tablet_manager.cc:1428] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 21:04:58.492450 27826 ts_tablet_manager.cc:1428] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 21:04:58.492470 27838 tablet_replica.cc:439] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } }
I20260810 21:04:58.492581 27838 tablet_replica.cc:442] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:58.492570 27832 tablet_replica.cc:439] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } }
I20260810 21:04:58.492636 27832 tablet_replica.cc:442] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:58.492836 27833 tablet_replica.cc:439] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } }
I20260810 21:04:58.492961 27833 tablet_replica.cc:442] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:58.563711 27833 raft_consensus.cc:482] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:58.563874 27833 raft_consensus.cc:504] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.564354 27833 leader_election.cc:288] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1:40197), 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2:42277)
I20260810 21:04:58.567915 27823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.564769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:34921 (local address 127.15.37.1:40197)
0810 21:04:58.564828 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.564831 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.564931 (+ 100us) server_negotiation.cc:407] Connection header received
0810 21:04:58.565059 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.565061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.565076 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.565138 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:58.565290 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.565801 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.566975 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.567514 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.567589 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.567601 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.567789 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.567838 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 21:04:58.568049 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.564719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:54751 (local address 127.15.37.2:42277)
0810 21:04:58.564794 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.564796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.564944 (+ 148us) server_negotiation.cc:407] Connection header received
0810 21:04:58.565059 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.565060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.565072 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.565105 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:04:58.565347 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.565811 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.567152 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.567689 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.567771 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.567782 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.567945 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.567987 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 21:04:58.568063 27891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.564600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:42277 (local address 127.15.37.3:54751)
0810 21:04:58.564870 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:58.564882 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:58.564974 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:58.565180 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:58.565181 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:58.565183 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:58.565268 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.565270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.565941 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.565942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.567051 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.567055 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.567775 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.567776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.567843 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.567851 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 21:04:58.567931 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 21:04:58.567972 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":76,"threads_started":1}
I20260810 21:04:58.568390 27440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e5571eda50424b890322f6f53161f1" candidate_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71291d0b0b2440ea899cd877f88750a0" is_pre_election: true
I20260810 21:04:58.568452 27892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.564597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:40197 (local address 127.15.37.3:34921)
0810 21:04:58.564843 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:58.564854 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:58.564948 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:58.565147 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:58.565148 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:58.565150 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:04:58.565216 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.565217 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.565893 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.565894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.566862 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.566865 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.567614 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.567615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.567691 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.567695 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:04:58.568314 (+ 619us) client_negotiation.cc:240] Negotiation successful
0810 21:04:58.568362 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":220,"mutex_wait_us":43,"thread_start_us":83,"threads_started":1}
I20260810 21:04:58.568545 27440 raft_consensus.cc:2454] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77b72eae3a9e4e51875d50ee9e15ddab in term 0.
I20260810 21:04:58.568758 27567 leader_election.cc:302] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71291d0b0b2440ea899cd877f88750a0, 77b72eae3a9e4e51875d50ee9e15ddab; no voters:
I20260810 21:04:58.568789 27212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e5571eda50424b890322f6f53161f1" candidate_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc28edfacd804ad6b20222ea0e5347a3" is_pre_election: true
I20260810 21:04:58.568873 27212 raft_consensus.cc:2454] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77b72eae3a9e4e51875d50ee9e15ddab in term 0.
I20260810 21:04:58.568900 27833 raft_consensus.cc:2781] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:58.568931 27833 raft_consensus.cc:482] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:58.568956 27833 raft_consensus.cc:3037] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.569808 27833 raft_consensus.cc:504] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.569993 27833 leader_election.cc:288] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [CANDIDATE]: Term 1 election: Requested vote from peers dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1:40197), 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2:42277)
I20260810 21:04:58.570154 27440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e5571eda50424b890322f6f53161f1" candidate_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71291d0b0b2440ea899cd877f88750a0"
I20260810 21:04:58.570209 27212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e5571eda50424b890322f6f53161f1" candidate_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc28edfacd804ad6b20222ea0e5347a3"
I20260810 21:04:58.570261 27440 raft_consensus.cc:3037] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.570267 27212 raft_consensus.cc:3037] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.571076 27440 raft_consensus.cc:2454] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77b72eae3a9e4e51875d50ee9e15ddab in term 1.
I20260810 21:04:58.571074 27212 raft_consensus.cc:2454] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77b72eae3a9e4e51875d50ee9e15ddab in term 1.
I20260810 21:04:58.571280 27567 leader_election.cc:302] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71291d0b0b2440ea899cd877f88750a0, 77b72eae3a9e4e51875d50ee9e15ddab; no voters:
I20260810 21:04:58.571380 27833 raft_consensus.cc:2781] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:58.571530 27833 raft_consensus.cc:686] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 LEADER]: Becoming Leader. State: Replica: 77b72eae3a9e4e51875d50ee9e15ddab, State: Running, Role: LEADER
I20260810 21:04:58.571616 27833 consensus_queue.cc:237] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.571980 27894 tablet_replica.cc:439] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab: TxnStatusTablet state changed. Reason: New leader 77b72eae3a9e4e51875d50ee9e15ddab. Latest consensus state: current_term: 1 leader_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } }
I20260810 21:04:58.572082 27894 tablet_replica.cc:442] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab: This TxnStatusTablet replica's current role is: LEADER
I20260810 21:04:58.572281 27898 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 21:04:58.572391 27898 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 21:04:58.572418 26978 catalog_manager.cc:5495] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab reported cstate change: term changed from 0 to 1, leader changed from <none> to 77b72eae3a9e4e51875d50ee9e15ddab (127.15.37.3). New cstate: current_term: 1 leader_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260810 21:04:58.588892 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.586299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41522 (local address 127.15.37.3:45571)
0810 21:04:58.586374 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.586376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.586387 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:04:58.586487 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.586488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.586509 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.586595 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:58.586746 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.587242 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.588021 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.588240 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.588320 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.588545 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:58.588653 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:58.588734 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.588790 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.588812 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 21:04:58.588924 27884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.586210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:45571 (local address 127.0.0.1:41522)
0810 21:04:58.586301 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:58.586331 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:58.586393 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:58.586605 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:58.586606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:58.586607 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 21:04:58.586664 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.586667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.587329 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.587330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.587928 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.587930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.588320 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.588321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.588389 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.588416 (+ 27us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 21:04:58.588731 (+ 315us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 21:04:58.588742 (+ 11us) client_negotiation.cc:769] Sending connection context
0810 21:04:58.588788 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 21:04:58.588849 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 21:04:58.590058 27440 raft_consensus.cc:1261] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Refusing update from remote peer 77b72eae3a9e4e51875d50ee9e15ddab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:58.590299 27212 raft_consensus.cc:1261] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Refusing update from remote peer 77b72eae3a9e4e51875d50ee9e15ddab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:58.590380 27894 consensus_queue.cc:1035] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [LEADER]: Connected to new peer: Peer: permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:58.590560 27894 consensus_queue.cc:1035] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:58.591028 27832 tablet_replica.cc:439] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0: TxnStatusTablet state changed. Reason: New leader 77b72eae3a9e4e51875d50ee9e15ddab. Latest consensus state: current_term: 1 leader_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } }
I20260810 21:04:58.591151 27832 tablet_replica.cc:442] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:58.591282 27838 tablet_replica.cc:439] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3: TxnStatusTablet state changed. Reason: New leader 77b72eae3a9e4e51875d50ee9e15ddab. Latest consensus state: current_term: 1 leader_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } }
I20260810 21:04:58.591374 27838 tablet_replica.cc:442] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:58.591933 27833 tablet_replica.cc:439] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } }
I20260810 21:04:58.592026 27833 tablet_replica.cc:442] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab: This TxnStatusTablet replica's current role is: LEADER
I20260810 21:04:58.592110 27832 tablet_replica.cc:439] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } }
I20260810 21:04:58.592186 27832 tablet_replica.cc:442] T 63e5571eda50424b890322f6f53161f1 P 71291d0b0b2440ea899cd877f88750a0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:58.592381 27844 mvcc.cc:205] Tried to move back new op lower bound from 7317077600622653440 to 7317077600549867520. Current Snapshot: MvccSnapshot[applied={T|T < 7317077600622653440 or (T in {7317077600622653440})}]
I20260810 21:04:58.593647 27894 tablet_replica.cc:439] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } }
I20260810 21:04:58.593735 27894 tablet_replica.cc:442] T 63e5571eda50424b890322f6f53161f1 P 77b72eae3a9e4e51875d50ee9e15ddab: This TxnStatusTablet replica's current role is: LEADER
I20260810 21:04:58.594117 27838 tablet_replica.cc:439] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } } }
I20260810 21:04:58.594213 27838 tablet_replica.cc:442] T 63e5571eda50424b890322f6f53161f1 P dc28edfacd804ad6b20222ea0e5347a3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 21:04:58.596414 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.593577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43870 (local address 127.15.37.2:42277)
0810 21:04:58.593616 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.593618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.593626 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:04:58.593662 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.593663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.593683 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.593751 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:58.593962 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.594690 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.595462 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.595782 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.595861 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.596065 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:58.596202 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:58.596279 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.596318 (+ 39us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.596339 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 21:04:58.602193 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.599274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:47987 (local address 127.15.37.3:45571)
0810 21:04:58.599331 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.599333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.599428 (+ 95us) server_negotiation.cc:407] Connection header received
0810 21:04:58.599491 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.599492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.599502 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.599552 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:58.599686 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.600197 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.601405 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.601599 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.601664 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.601906 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:58.601954 (+ 48us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:58.602009 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.602109 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.602129 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 21:04:58.602245 27905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.599184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:45571 (local address 127.15.37.2:47987)
0810 21:04:58.599355 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:58.599366 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:58.599430 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:58.599557 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:58.599558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:58.599560 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 21:04:58.599623 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.599625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.600283 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.600284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.601304 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.601307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.601692 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.601693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.601765 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.601789 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 21:04:58.602042 (+ 253us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 21:04:58.602044 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 21:04:58.602098 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 21:04:58.602152 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260810 21:04:58.604799 27692 raft_consensus.cc:1261] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Refusing update from remote peer 71291d0b0b2440ea899cd877f88750a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:58.604822 27212 raft_consensus.cc:1261] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Refusing update from remote peer 71291d0b0b2440ea899cd877f88750a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:58.605113 27870 consensus_queue.cc:1035] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:58.605319 27832 consensus_queue.cc:1035] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:58.607506 27843 mvcc.cc:205] Tried to move back new op lower bound from 7317077600683270144 to 7317077599910809600. Current Snapshot: MvccSnapshot[applied={T|T < 7317077600683270144}]
I20260810 21:04:58.615455 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.612171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:57145 (local address 127.15.37.2:42277)
0810 21:04:58.612214 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.612216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.612396 (+ 180us) server_negotiation.cc:407] Connection header received
0810 21:04:58.612529 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.612531 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.612544 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.612602 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:58.612833 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.613583 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.614596 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.614891 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.614972 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.615169 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:58.615209 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:58.615277 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.615342 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.615364 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 21:04:58.615480 27913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.612129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:42277 (local address 127.15.37.3:57145)
0810 21:04:58.612332 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:58.612343 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:58.612427 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:58.612669 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:58.612670 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:58.612672 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 21:04:58.612754 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.612756 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.613659 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.613660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.614523 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.614526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.614971 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.614972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.615041 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.615066 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 21:04:58.615279 (+ 213us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 21:04:58.615282 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:04:58.615335 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 21:04:58.615383 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":96,"threads_started":1}
I20260810 21:04:58.625392 26978 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:58.625536 26978 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:58.626272 26978 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a: Sending DeleteTablet for 3 replicas of tablet 57cc5868823d48d7a093a1dd24d46022
I20260810 21:04:58.626569 27406 tablet_service.cc:1514] Processing DeleteTablet for tablet 57cc5868823d48d7a093a1dd24d46022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:58 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:43862
I20260810 21:04:58.626668 27860 tablet_replica.cc:330] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0: stopping tablet replica
I20260810 21:04:58.626721 27860 raft_consensus.cc:2229] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:04:58.626811 27860 raft_consensus.cc:2258] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:58.627184 27185 tablet_service.cc:1514] Processing DeleteTablet for tablet 57cc5868823d48d7a093a1dd24d46022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:58 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34886
I20260810 21:04:58.627285 27858 tablet_replica.cc:330] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3: stopping tablet replica
I20260810 21:04:58.627331 27858 raft_consensus.cc:2229] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:58.627339 27860 ts_tablet_manager.cc:1905] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:58.627365 27858 raft_consensus.cc:2258] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:58.628834 27860 ts_tablet_manager.cc:1918] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:58.628901 27860 log.cc:1196] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/57cc5868823d48d7a093a1dd24d46022
I20260810 21:04:58.628918 27858 ts_tablet_manager.cc:1905] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:58.628906 27655 tablet_service.cc:1514] Processing DeleteTablet for tablet 57cc5868823d48d7a093a1dd24d46022 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:58 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:41506
I20260810 21:04:58.629012 27861 tablet_replica.cc:330] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab: stopping tablet replica
I20260810 21:04:58.629055 27861 raft_consensus.cc:2229] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:58.629092 27861 raft_consensus.cc:2258] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:58.629153 27860 ts_tablet_manager.cc:1939] T 57cc5868823d48d7a093a1dd24d46022 P 71291d0b0b2440ea899cd877f88750a0: Deleting consensus metadata
I20260810 21:04:58.629462 26956 catalog_manager.cc:4841] TS 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2:42277): tablet 57cc5868823d48d7a093a1dd24d46022 (table test-table [id=4017a6c2b5f14180a4064a6d65fb6c7f]) successfully deleted
I20260810 21:04:58.630796 27858 ts_tablet_manager.cc:1918] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:58.630865 27858 log.cc:1196] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/wal/wals/57cc5868823d48d7a093a1dd24d46022
I20260810 21:04:58.631080 27858 ts_tablet_manager.cc:1939] T 57cc5868823d48d7a093a1dd24d46022 P dc28edfacd804ad6b20222ea0e5347a3: Deleting consensus metadata
I20260810 21:04:58.631767 26955 catalog_manager.cc:4841] TS dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1:40197): tablet 57cc5868823d48d7a093a1dd24d46022 (table test-table [id=4017a6c2b5f14180a4064a6d65fb6c7f]) successfully deleted
I20260810 21:04:58.632580 27861 ts_tablet_manager.cc:1905] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:58.634021 27861 ts_tablet_manager.cc:1918] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:58.634091 27861 log.cc:1196] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/57cc5868823d48d7a093a1dd24d46022
I20260810 21:04:58.634321 27861 ts_tablet_manager.cc:1939] T 57cc5868823d48d7a093a1dd24d46022 P 77b72eae3a9e4e51875d50ee9e15ddab: Deleting consensus metadata
I20260810 21:04:58.634680 26955 catalog_manager.cc:4841] TS 77b72eae3a9e4e51875d50ee9e15ddab (127.15.37.3:45571): tablet 57cc5868823d48d7a093a1dd24d46022 (table test-table [id=4017a6c2b5f14180a4064a6d65fb6c7f]) successfully deleted
Aug 10 21:04:58 dist-test-slave-jq4t krb5kdc[26908](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 21:04:58 dist-test-slave-jq4t krb5kdc[26908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:04:58 dist-test-slave-jq4t krb5kdc[26908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
W20260810 21:04:58.658102 27886 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:04:58.651734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44172 (local address 127.15.37.62:44617)
0810 21:04:58.651797 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.651800 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.651941 (+ 141us) server_negotiation.cc:407] Connection header received
0810 21:04:58.652038 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.652039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.652051 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.652105 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:58.652789 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.653507 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.654478 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.654709 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.654790 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.658028 (+ 3238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44172: BlockingRecv error: recv got EOF from 127.0.0.1:44172 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 10 21:04:58 dist-test-slave-jq4t krb5kdc[26908](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM
I20260810 21:04:58.667423 27886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.659309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44188 (local address 127.15.37.62:44617)
0810 21:04:58.659358 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.659360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.659617 (+ 257us) server_negotiation.cc:407] Connection header received
0810 21:04:58.659717 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.659717 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.659729 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.659777 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:04:58.660370 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.661108 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.661942 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.662160 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.662239 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.664705 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:04:58.664707 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:04:58.664708 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:04:58.664716 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:04:58.666219 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:58.666590 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:58.666592 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:58.666592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:58.666655 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:04:58.666870 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:04:58.666871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:04:58.666871 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:04:58.666994 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:04:58.667105 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.667204 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.667297 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 21:04:58.669261 26978 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44188:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:58.669473 26978 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:58.670996 27406 tablet_service.cc:1467] Processing CreateTablet for tablet 6036f525c01e4681b6ca0e978dcc207b (DEFAULT_TABLE table=test-table [id=7022ef4114e848acbf315f7e256b16f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:58.671005 27185 tablet_service.cc:1467] Processing CreateTablet for tablet 6036f525c01e4681b6ca0e978dcc207b (DEFAULT_TABLE table=test-table [id=7022ef4114e848acbf315f7e256b16f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:58.671154 27406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6036f525c01e4681b6ca0e978dcc207b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:58.671159 27185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6036f525c01e4681b6ca0e978dcc207b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:58.672564 27831 tablet_bootstrap.cc:492] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3: Bootstrap starting.
I20260810 21:04:58.672598 27655 tablet_service.cc:1467] Processing CreateTablet for tablet 6036f525c01e4681b6ca0e978dcc207b (DEFAULT_TABLE table=test-table [id=7022ef4114e848acbf315f7e256b16f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:58.672720 27655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6036f525c01e4681b6ca0e978dcc207b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:58.672938 27831 tablet_bootstrap.cc:654] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:58.674015 27826 tablet_bootstrap.cc:492] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab: Bootstrap starting.
I20260810 21:04:58.674060 27827 tablet_bootstrap.cc:492] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0: Bootstrap starting.
I20260810 21:04:58.674458 27826 tablet_bootstrap.cc:654] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:58.674503 27827 tablet_bootstrap.cc:654] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:58.675635 27827 tablet_bootstrap.cc:492] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0: No bootstrap required, opened a new log
I20260810 21:04:58.675652 27826 tablet_bootstrap.cc:492] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab: No bootstrap required, opened a new log
I20260810 21:04:58.675690 27827 ts_tablet_manager.cc:1397] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 21:04:58.675691 27826 ts_tablet_manager.cc:1397] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:04:58.675856 27827 raft_consensus.cc:348] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.675856 27826 raft_consensus.cc:348] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.675925 27827 raft_consensus.cc:374] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:58.675936 27826 raft_consensus.cc:374] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:58.675948 27827 raft_consensus.cc:729] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71291d0b0b2440ea899cd877f88750a0, State: Initialized, Role: FOLLOWER
I20260810 21:04:58.675961 27826 raft_consensus.cc:729] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77b72eae3a9e4e51875d50ee9e15ddab, State: Initialized, Role: FOLLOWER
I20260810 21:04:58.675997 27827 consensus_queue.cc:260] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.676003 27826 consensus_queue.cc:260] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.676092 27827 ts_tablet_manager.cc:1428] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:58.676091 27826 ts_tablet_manager.cc:1428] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:58.677026 27831 tablet_bootstrap.cc:492] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3: No bootstrap required, opened a new log
I20260810 21:04:58.677088 27831 ts_tablet_manager.cc:1397] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260810 21:04:58.677210 27831 raft_consensus.cc:348] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.677292 27831 raft_consensus.cc:374] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:58.677314 27831 raft_consensus.cc:729] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc28edfacd804ad6b20222ea0e5347a3, State: Initialized, Role: FOLLOWER
I20260810 21:04:58.677353 27831 consensus_queue.cc:260] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.677464 27831 ts_tablet_manager.cc:1428] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 21:04:58.753695 27894 raft_consensus.cc:482] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:58.753832 27894 raft_consensus.cc:504] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.754020 27894 leader_election.cc:288] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1:40197), 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2:42277)
I20260810 21:04:58.754292 27440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6036f525c01e4681b6ca0e978dcc207b" candidate_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71291d0b0b2440ea899cd877f88750a0" is_pre_election: true
I20260810 21:04:58.754308 27210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6036f525c01e4681b6ca0e978dcc207b" candidate_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc28edfacd804ad6b20222ea0e5347a3" is_pre_election: true
I20260810 21:04:58.754390 27440 raft_consensus.cc:2454] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77b72eae3a9e4e51875d50ee9e15ddab in term 0.
I20260810 21:04:58.754400 27210 raft_consensus.cc:2454] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77b72eae3a9e4e51875d50ee9e15ddab in term 0.
I20260810 21:04:58.754585 27567 leader_election.cc:302] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71291d0b0b2440ea899cd877f88750a0, 77b72eae3a9e4e51875d50ee9e15ddab; no voters:
I20260810 21:04:58.754668 27894 raft_consensus.cc:2781] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:58.754693 27894 raft_consensus.cc:482] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:58.754714 27894 raft_consensus.cc:3037] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.755571 27894 raft_consensus.cc:504] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.755723 27894 leader_election.cc:288] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [CANDIDATE]: Term 1 election: Requested vote from peers dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1:40197), 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2:42277)
I20260810 21:04:58.755923 27210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6036f525c01e4681b6ca0e978dcc207b" candidate_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc28edfacd804ad6b20222ea0e5347a3"
I20260810 21:04:58.755940 27440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6036f525c01e4681b6ca0e978dcc207b" candidate_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71291d0b0b2440ea899cd877f88750a0"
I20260810 21:04:58.756006 27210 raft_consensus.cc:3037] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.756017 27440 raft_consensus.cc:3037] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.756871 27440 raft_consensus.cc:2454] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77b72eae3a9e4e51875d50ee9e15ddab in term 1.
I20260810 21:04:58.756946 27210 raft_consensus.cc:2454] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77b72eae3a9e4e51875d50ee9e15ddab in term 1.
I20260810 21:04:58.757081 27567 leader_election.cc:302] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71291d0b0b2440ea899cd877f88750a0, 77b72eae3a9e4e51875d50ee9e15ddab; no voters:
I20260810 21:04:58.757181 27894 raft_consensus.cc:2781] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:58.757223 27894 raft_consensus.cc:686] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 LEADER]: Becoming Leader. State: Replica: 77b72eae3a9e4e51875d50ee9e15ddab, State: Running, Role: LEADER
I20260810 21:04:58.757280 27894 consensus_queue.cc:237] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.757925 26978 catalog_manager.cc:5495] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab reported cstate change: term changed from 0 to 1, leader changed from <none> to 77b72eae3a9e4e51875d50ee9e15ddab (127.15.37.3). New cstate: current_term: 1 leader_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260810 21:04:58.772090 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.769074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41538 (local address 127.15.37.3:45571)
0810 21:04:58.769135 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.769137 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.769147 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:04:58.769179 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.769180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.769194 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.769277 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:58.769467 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.770225 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.771242 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.771538 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.771629 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.771813 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:58.771856 (+ 43us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:58.771915 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.771977 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.772004 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 21:04:58.773216 27440 raft_consensus.cc:1261] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Refusing update from remote peer 77b72eae3a9e4e51875d50ee9e15ddab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:58.773216 27210 raft_consensus.cc:1261] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Refusing update from remote peer 77b72eae3a9e4e51875d50ee9e15ddab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:58.773473 27909 consensus_queue.cc:1035] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [LEADER]: Connected to new peer: Peer: permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:58.773641 27909 consensus_queue.cc:1035] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:58.777838 26977 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:58.777967 26977 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:58.778671 26977 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a: Sending DeleteTablet for 3 replicas of tablet 6036f525c01e4681b6ca0e978dcc207b
I20260810 21:04:58.778973 27185 tablet_service.cc:1514] Processing DeleteTablet for tablet 6036f525c01e4681b6ca0e978dcc207b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:58 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34886
I20260810 21:04:58.779018 27655 tablet_service.cc:1514] Processing DeleteTablet for tablet 6036f525c01e4681b6ca0e978dcc207b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:58 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:41506
I20260810 21:04:58.779076 27858 tablet_replica.cc:330] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3: stopping tablet replica
I20260810 21:04:58.779112 27861 tablet_replica.cc:330] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab: stopping tablet replica
I20260810 21:04:58.779131 27858 raft_consensus.cc:2229] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:58.779157 27861 raft_consensus.cc:2229] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:04:58.779175 27858 raft_consensus.cc:2258] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:58.779259 27861 raft_consensus.cc:2258] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:58.779664 27861 ts_tablet_manager.cc:1905] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:58.779733 27858 ts_tablet_manager.cc:1905] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:58.781322 27861 ts_tablet_manager.cc:1918] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:58.781329 27858 ts_tablet_manager.cc:1918] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:58.781378 27861 log.cc:1196] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/6036f525c01e4681b6ca0e978dcc207b
I20260810 21:04:58.781423 27858 log.cc:1196] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-0/wal/wals/6036f525c01e4681b6ca0e978dcc207b
I20260810 21:04:58.781617 27861 ts_tablet_manager.cc:1939] T 6036f525c01e4681b6ca0e978dcc207b P 77b72eae3a9e4e51875d50ee9e15ddab: Deleting consensus metadata
I20260810 21:04:58.781661 27858 ts_tablet_manager.cc:1939] T 6036f525c01e4681b6ca0e978dcc207b P dc28edfacd804ad6b20222ea0e5347a3: Deleting consensus metadata
I20260810 21:04:58.781939 27406 tablet_service.cc:1514] Processing DeleteTablet for tablet 6036f525c01e4681b6ca0e978dcc207b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:58 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:43862
I20260810 21:04:58.782050 27860 tablet_replica.cc:330] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0: stopping tablet replica
I20260810 21:04:58.782109 27860 raft_consensus.cc:2229] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:58.782160 27860 raft_consensus.cc:2258] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:58.782249 26955 catalog_manager.cc:4841] TS dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1:40197): tablet 6036f525c01e4681b6ca0e978dcc207b (table test-table [id=7022ef4114e848acbf315f7e256b16f3]) successfully deleted
I20260810 21:04:58.782691 26955 catalog_manager.cc:4841] TS 77b72eae3a9e4e51875d50ee9e15ddab (127.15.37.3:45571): tablet 6036f525c01e4681b6ca0e978dcc207b (table test-table [id=7022ef4114e848acbf315f7e256b16f3]) successfully deleted
I20260810 21:04:58.782720 27860 ts_tablet_manager.cc:1905] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:58.784101 27860 ts_tablet_manager.cc:1918] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:04:58.784166 27860 log.cc:1196] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/6036f525c01e4681b6ca0e978dcc207b
I20260810 21:04:58.784375 27860 ts_tablet_manager.cc:1939] T 6036f525c01e4681b6ca0e978dcc207b P 71291d0b0b2440ea899cd877f88750a0: Deleting consensus metadata
I20260810 21:04:58.784775 26956 catalog_manager.cc:4841] TS 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2:42277): tablet 6036f525c01e4681b6ca0e978dcc207b (table test-table [id=7022ef4114e848acbf315f7e256b16f3]) successfully deleted
I20260810 21:04:58.785024 26977 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44188:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:04:58.785197 26977 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:04:58.786680 27185 tablet_service.cc:1467] Processing CreateTablet for tablet 0ebccfb9d1ca46ac897b161d06d61400 (DEFAULT_TABLE table=test-table [id=38167602a7b1457a9a18eaeb81c2ca1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:58.786818 27185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ebccfb9d1ca46ac897b161d06d61400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:58.788123 27831 tablet_bootstrap.cc:492] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3: Bootstrap starting.
I20260810 21:04:58.788249 27406 tablet_service.cc:1467] Processing CreateTablet for tablet 0ebccfb9d1ca46ac897b161d06d61400 (DEFAULT_TABLE table=test-table [id=38167602a7b1457a9a18eaeb81c2ca1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:58.788450 27406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ebccfb9d1ca46ac897b161d06d61400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:58.788492 27831 tablet_bootstrap.cc:654] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:58.789705 27827 tablet_bootstrap.cc:492] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0: Bootstrap starting.
I20260810 21:04:58.789799 27655 tablet_service.cc:1467] Processing CreateTablet for tablet 0ebccfb9d1ca46ac897b161d06d61400 (DEFAULT_TABLE table=test-table [id=38167602a7b1457a9a18eaeb81c2ca1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:04:58.789937 27655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ebccfb9d1ca46ac897b161d06d61400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:04:58.790139 27827 tablet_bootstrap.cc:654] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:58.791028 27827 tablet_bootstrap.cc:492] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0: No bootstrap required, opened a new log
I20260810 21:04:58.791078 27827 ts_tablet_manager.cc:1397] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 21:04:58.791229 27827 raft_consensus.cc:348] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.791298 27827 raft_consensus.cc:374] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:58.791318 27827 raft_consensus.cc:729] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71291d0b0b2440ea899cd877f88750a0, State: Initialized, Role: FOLLOWER
I20260810 21:04:58.791363 27826 tablet_bootstrap.cc:492] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab: Bootstrap starting.
I20260810 21:04:58.791386 27827 consensus_queue.cc:260] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.791476 27827 ts_tablet_manager.cc:1428] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:58.791694 27826 tablet_bootstrap.cc:654] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab: Neither blocks nor log segments found. Creating new log.
I20260810 21:04:58.792299 27826 tablet_bootstrap.cc:492] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab: No bootstrap required, opened a new log
I20260810 21:04:58.792351 27826 ts_tablet_manager.cc:1397] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 21:04:58.792466 27826 raft_consensus.cc:348] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.792574 27826 raft_consensus.cc:374] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:58.792600 27826 raft_consensus.cc:729] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77b72eae3a9e4e51875d50ee9e15ddab, State: Initialized, Role: FOLLOWER
I20260810 21:04:58.792646 27826 consensus_queue.cc:260] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.792740 27826 ts_tablet_manager.cc:1428] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:58.793637 27831 tablet_bootstrap.cc:492] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3: No bootstrap required, opened a new log
I20260810 21:04:58.793697 27831 ts_tablet_manager.cc:1397] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260810 21:04:58.793813 27831 raft_consensus.cc:348] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.793881 27831 raft_consensus.cc:374] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:04:58.793902 27831 raft_consensus.cc:729] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc28edfacd804ad6b20222ea0e5347a3, State: Initialized, Role: FOLLOWER
I20260810 21:04:58.793952 27831 consensus_queue.cc:260] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.794051 27831 ts_tablet_manager.cc:1428] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:04:58.795078 27909 raft_consensus.cc:482] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:04:58.795151 27909 raft_consensus.cc:504] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.795293 27909 leader_election.cc:288] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1:40197), 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2:42277)
I20260810 21:04:58.795452 27210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ebccfb9d1ca46ac897b161d06d61400" candidate_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc28edfacd804ad6b20222ea0e5347a3" is_pre_election: true
I20260810 21:04:58.795542 27210 raft_consensus.cc:2454] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77b72eae3a9e4e51875d50ee9e15ddab in term 0.
I20260810 21:04:58.795569 27440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ebccfb9d1ca46ac897b161d06d61400" candidate_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71291d0b0b2440ea899cd877f88750a0" is_pre_election: true
I20260810 21:04:58.795663 27440 raft_consensus.cc:2454] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77b72eae3a9e4e51875d50ee9e15ddab in term 0.
I20260810 21:04:58.795835 27566 leader_election.cc:302] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77b72eae3a9e4e51875d50ee9e15ddab, dc28edfacd804ad6b20222ea0e5347a3; no voters:
I20260810 21:04:58.795924 27909 raft_consensus.cc:2781] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:04:58.795981 27909 raft_consensus.cc:482] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:04:58.796007 27909 raft_consensus.cc:3037] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.796865 27909 raft_consensus.cc:504] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.797001 27909 leader_election.cc:288] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [CANDIDATE]: Term 1 election: Requested vote from peers dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1:40197), 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2:42277)
I20260810 21:04:58.797227 27210 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ebccfb9d1ca46ac897b161d06d61400" candidate_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc28edfacd804ad6b20222ea0e5347a3"
I20260810 21:04:58.797307 27210 raft_consensus.cc:3037] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.797436 27440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ebccfb9d1ca46ac897b161d06d61400" candidate_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71291d0b0b2440ea899cd877f88750a0"
I20260810 21:04:58.797508 27440 raft_consensus.cc:3037] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:04:58.798100 27210 raft_consensus.cc:2454] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77b72eae3a9e4e51875d50ee9e15ddab in term 1.
I20260810 21:04:58.798218 27440 raft_consensus.cc:2454] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77b72eae3a9e4e51875d50ee9e15ddab in term 1.
I20260810 21:04:58.798419 27566 leader_election.cc:302] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77b72eae3a9e4e51875d50ee9e15ddab, dc28edfacd804ad6b20222ea0e5347a3; no voters:
I20260810 21:04:58.798503 27909 raft_consensus.cc:2781] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:04:58.798560 27909 raft_consensus.cc:686] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 LEADER]: Becoming Leader. State: Replica: 77b72eae3a9e4e51875d50ee9e15ddab, State: Running, Role: LEADER
I20260810 21:04:58.798611 27909 consensus_queue.cc:237] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } }
I20260810 21:04:58.799149 26977 catalog_manager.cc:5495] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab reported cstate change: term changed from 0 to 1, leader changed from <none> to 77b72eae3a9e4e51875d50ee9e15ddab (127.15.37.3). New cstate: current_term: 1 leader_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77b72eae3a9e4e51875d50ee9e15ddab" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260810 21:04:58.811419 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.808953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:52459 (local address 127.15.37.3:45571)
0810 21:04:58.808996 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 21:04:58.808998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:04:58.809006 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:04:58.809079 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:04:58.809080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:04:58.809089 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:04:58.809135 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:04:58.809270 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.809747 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.810779 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.810973 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.811027 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.811180 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:04:58.811207 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:04:58.811241 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0810 21:04:58.811295 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 21:04:58.811317 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":22}
I20260810 21:04:58.811501 27913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.808905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:45571 (local address 127.15.37.3:52459)
0810 21:04:58.808955 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:58.808969 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:04:58.809021 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:04:58.809159 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:04:58.809160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:04:58.809162 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 21:04:58.809210 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.809211 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.809816 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.809817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.810693 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:04:58.810696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:04:58.811047 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:04:58.811048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:04:58.811109 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:04:58.811116 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 21:04:58.811242 (+ 126us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 21:04:58.811244 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 21:04:58.811293 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 21:04:58.811350 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260810 21:04:58.813869 27439 raft_consensus.cc:1261] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Refusing update from remote peer 77b72eae3a9e4e51875d50ee9e15ddab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:58.813907 27210 raft_consensus.cc:1261] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Refusing update from remote peer 77b72eae3a9e4e51875d50ee9e15ddab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:04:58.814134 27909 consensus_queue.cc:1035] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [LEADER]: Connected to new peer: Peer: permanent_uuid: "71291d0b0b2440ea899cd877f88750a0" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 42277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:58.814265 27894 consensus_queue.cc:1035] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc28edfacd804ad6b20222ea0e5347a3" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 40197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:04:58.824424 26977 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:58.824594 26977 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:04:58.825250 26977 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 67d130a0e5984edea7bfa3537adc154a: Sending DeleteTablet for 3 replicas of tablet 0ebccfb9d1ca46ac897b161d06d61400
I20260810 21:04:58.825562 27185 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ebccfb9d1ca46ac897b161d06d61400 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:58 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34886
I20260810 21:04:58.825680 27406 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ebccfb9d1ca46ac897b161d06d61400 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:58 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:43862
I20260810 21:04:58.825775 27858 tablet_replica.cc:330] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3: stopping tablet replica
I20260810 21:04:58.825836 27858 raft_consensus.cc:2229] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:58.825875 27858 raft_consensus.cc:2258] T 0ebccfb9d1ca46ac897b161d06d61400 P dc28edfacd804ad6b20222ea0e5347a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:58.825865 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 27081
I20260810 21:04:58.825945 27860 tablet_replica.cc:330] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0: stopping tablet replica
I20260810 21:04:58.825999 27860 raft_consensus.cc:2229] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:04:58.826040 27860 raft_consensus.cc:2258] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:58.829160 27655 tablet_service.cc:1514] Processing DeleteTablet for tablet 0ebccfb9d1ca46ac897b161d06d61400 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:04:58 UTC) from {username='oryx', principal='oryx/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:41506
I20260810 21:04:58.829262 27861 tablet_replica.cc:330] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab: stopping tablet replica
I20260810 21:04:58.829329 27861 raft_consensus.cc:2229] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:04:58.829402 27861 raft_consensus.cc:2258] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:04:58.832059 27860 ts_tablet_manager.cc:1905] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:58.832861 27861 ts_tablet_manager.cc:1905] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:04:58.833703 27860 ts_tablet_manager.cc:1918] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:58.833760 27860 log.cc:1196] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/0ebccfb9d1ca46ac897b161d06d61400
I20260810 21:04:58.833978 27860 ts_tablet_manager.cc:1939] T 0ebccfb9d1ca46ac897b161d06d61400 P 71291d0b0b2440ea899cd877f88750a0: Deleting consensus metadata
I20260810 21:04:58.834354 26956 catalog_manager.cc:4841] TS 71291d0b0b2440ea899cd877f88750a0 (127.15.37.2:42277): tablet 0ebccfb9d1ca46ac897b161d06d61400 (table test-table [id=38167602a7b1457a9a18eaeb81c2ca1d]) successfully deleted
I20260810 21:04:58.834975 27861 ts_tablet_manager.cc:1918] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 21:04:58.835031 27861 log.cc:1196] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/0ebccfb9d1ca46ac897b161d06d61400
I20260810 21:04:58.835266 27861 ts_tablet_manager.cc:1939] T 0ebccfb9d1ca46ac897b161d06d61400 P 77b72eae3a9e4e51875d50ee9e15ddab: Deleting consensus metadata
I20260810 21:04:58.836802 26955 catalog_manager.cc:4841] TS 77b72eae3a9e4e51875d50ee9e15ddab (127.15.37.3:45571): tablet 0ebccfb9d1ca46ac897b161d06d61400 (table test-table [id=38167602a7b1457a9a18eaeb81c2ca1d]) successfully deleted
W20260810 21:04:58.842733 26955 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:40197 (error 108)
I20260810 21:04:58.843053 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 27296
I20260810 21:04:58.847579 27962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:04:58.847190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:40197 (local address 127.0.0.1:34918)
0810 21:04:58.847420 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 21:04:58.847510 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:40197: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":109,"threads_started":1}
W20260810 21:04:58.849787 26955 catalog_manager.cc:4584] TS dc28edfacd804ad6b20222ea0e5347a3 (127.15.37.1:40197): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0ebccfb9d1ca46ac897b161d06d61400: Network error: Client connection negotiation failed: client connection to 127.15.37.1:40197: connect: Connection refused (error 111)
I20260810 21:04:58.859486 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 27533
I20260810 21:04:58.882717 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 26927
2026-08-10T21:04:58Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3095 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:04:58 dist-test-slave-jq4t krb5kdc[27969](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:04:58 dist-test-slave-jq4t krb5kdc[27969](info): set up 2 sockets
Aug 10 21:04:58 dist-test-slave-jq4t krb5kdc[27969](info): commencing operation
krb5kdc: starting...
W20260810 21:05:00.173781 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:05:00 dist-test-slave-jq4t krb5kdc[27969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395900, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:05:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:05:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:05:00.308569 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:43821
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:39179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:43821
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:05:00.396966 27992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:00.397234 27992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:00.397279 27992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:00.398540 27992 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:05:00.398622 27992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:00.398646 27992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:00.398682 27992 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:05:00.398732 27992 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:05:00.400409 27992 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:39179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:43821
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:43821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:00.400753 27992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:00.401051 27992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:00.406531 28008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:00.406553 28004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:00.406601 27992 server_base.cc:1034] running on GCE node
W20260810 21:05:00.406535 28003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:00.407092 27992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:00.407433 27992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:00.408598 27992 hybrid_clock.cc:648] HybridClock initialized: now 1786395900408572 us; error 42 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-10T21:05:00Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1529 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:05:00 dist-test-slave-jq4t krb5kdc[28018](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:05:00 dist-test-slave-jq4t krb5kdc[28018](info): set up 2 sockets
Aug 10 21:05:00 dist-test-slave-jq4t krb5kdc[28018](info): commencing operation
krb5kdc: starting...
W20260810 21:05:01.688438 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:05:01 dist-test-slave-jq4t krb5kdc[28018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:05:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:05:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:05:01.823765 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:42197
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:42197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:05:01.911743 28035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:01.911998 28035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:01.912024 28035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:01.913336 28035 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:05:01.913405 28035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:01.913420 28035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:01.913434 28035 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:05:01.913445 28035 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:05:01.915220 28035 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:42197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:42197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:01.915565 28035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:01.915841 28035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:01.921376 28043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:01.921396 28047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:01.921396 28042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:01.921703 28035 server_base.cc:1034] running on GCE node
I20260810 21:05:01.922008 28035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:01.922318 28035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:01.923471 28035 hybrid_clock.cc:648] HybridClock initialized: now 1786395901923464 us; error 35 us; skew 500 ppm
Aug 10 21:05:01 dist-test-slave-jq4t krb5kdc[28018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395901, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:05:01.934389 28035 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:05:01.935043 28035 webserver.cc:460] Webserver started at http://127.15.37.62:39291/ using document root <none> and password file <none>
I20260810 21:05:01.935325 28035 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:01.935403 28035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:01.935566 28035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:01.936864 28035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "229f53f1ed0c4a49a75ccae22ed65ce5"
format_stamp: "Formatted at 2026-08-10 21:05:01 on dist-test-slave-jq4t"
server_key: "3b5093c7d68e8ff7e99b83ee809fd3a1"
server_key_iv: "7f88dd156fd28e725d1927ba73e98250"
server_key_version: "encryptionkey@0"
I20260810 21:05:01.937261 28035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "229f53f1ed0c4a49a75ccae22ed65ce5"
format_stamp: "Formatted at 2026-08-10 21:05:01 on dist-test-slave-jq4t"
server_key: "3b5093c7d68e8ff7e99b83ee809fd3a1"
server_key_iv: "7f88dd156fd28e725d1927ba73e98250"
server_key_version: "encryptionkey@0"
I20260810 21:05:01.938861 28035 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:05:01.939884 28059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:01.940193 28035 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:05:01.940338 28035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "229f53f1ed0c4a49a75ccae22ed65ce5"
format_stamp: "Formatted at 2026-08-10 21:05:01 on dist-test-slave-jq4t"
server_key: "3b5093c7d68e8ff7e99b83ee809fd3a1"
server_key_iv: "7f88dd156fd28e725d1927ba73e98250"
server_key_version: "encryptionkey@0"
I20260810 21:05:01.940435 28035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:01.966250 28035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:01.968685 28035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:01.968885 28035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:01.973441 28035 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:42197
I20260810 21:05:01.973505 28143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:42197 every 8 connection(s)
I20260810 21:05:01.974013 28035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:05:01.975273 28145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:05:01.978442 28145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5: Bootstrap starting.
I20260810 21:05:01.979167 28145 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5: Neither blocks nor log segments found. Creating new log.
I20260810 21:05:01.979590 28145 log.cc:824] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5: Log is configured to *not* fsync() on all Append() calls
I20260810 21:05:01.980682 28145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5: No bootstrap required, opened a new log
I20260810 21:05:01.980809 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 28035
I20260810 21:05:01.980949 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:05:01.981189 15508 external_mini_cluster.cc:1428] Setting key 117ab9edfca4a5ddc3b1a9c4aab5f98b
I20260810 21:05:01.983824 28145 raft_consensus.cc:348] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42197 } }
I20260810 21:05:01.984056 28145 raft_consensus.cc:374] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:05:01.984100 28145 raft_consensus.cc:729] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 229f53f1ed0c4a49a75ccae22ed65ce5, State: Initialized, Role: FOLLOWER
I20260810 21:05:01.984337 28145 consensus_queue.cc:260] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42197 } }
I20260810 21:05:01.984445 28145 raft_consensus.cc:388] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:05:01.984501 28145 raft_consensus.cc:482] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:05:01.984560 28145 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:05:01.986033 28145 raft_consensus.cc:504] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42197 } }
I20260810 21:05:01.986195 28145 leader_election.cc:302] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 229f53f1ed0c4a49a75ccae22ed65ce5; no voters:
I20260810 21:05:01.986406 28145 leader_election.cc:288] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:05:01.986524 28154 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:05:01.986701 28154 raft_consensus.cc:686] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 1 LEADER]: Becoming Leader. State: Replica: 229f53f1ed0c4a49a75ccae22ed65ce5, State: Running, Role: LEADER
I20260810 21:05:01.986702 28145 sys_catalog.cc:564] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:05:01.990665 28154 consensus_queue.cc:237] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42197 } }
I20260810 21:05:01.991590 28157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42197 } } }
I20260810 21:05:01.991698 28157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:05:01.991674 28156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 229f53f1ed0c4a49a75ccae22ed65ce5. Latest consensus state: current_term: 1 leader_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42197 } } }
I20260810 21:05:01.991789 28156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [sys.catalog]: This master's current role is: LEADER
Aug 10 21:05:01 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
W20260810 21:05:01.992818 28179 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:05:01.992880 28179 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:05:01.992947 28177 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:05:01.993147 28177 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:05:01.994951 28177 catalog_manager.cc:1347] Generated new cluster ID: 3771399a9d1a407ba010500e78737182
I20260810 21:05:01.995015 28177 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:05:01.997205 28153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:01.981766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41826 (local address 127.15.37.62:42197)
0810 21:05:01.982086 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:01.982097 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:01.982157 (+ 60us) server_negotiation.cc:407] Connection header received
0810 21:05:01.983846 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:01.983861 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:01.983958 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:01.984130 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:01.985347 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:01.987130 (+ 1783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:01.988401 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:01.989105 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:01.989558 (+ 453us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:01.992897 (+ 3339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:01.992903 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:01.992904 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:05:01.992920 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:01.995295 (+ 2375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:01.995760 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:01.995766 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:01.995767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:01.995882 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:01.996141 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:01.996142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:01.996143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:01.996434 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:01.996715 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:01.996793 (+ 78us) server_negotiation.cc:299] Negotiation successful
0810 21:05:01.996969 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":84,"threads_started":1}
I20260810 21:05:02.013141 28177 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:05:02.013978 28177 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:05:02.018828 28177 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5: Generated new TSK 0
I20260810 21:05:02.019073 28177 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:05:02.059861 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42197
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:05:02.152693 28185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:02.152928 28185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:02.152956 28185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:02.154350 28185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:02.154409 28185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:02.154438 28185 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:05:02.156105 28185 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:02.156384 28185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:02.156693 28185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:02.162091 28193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:02.162083 28191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:02.162600 28185 server_base.cc:1034] running on GCE node
W20260810 21:05:02.162616 28197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:02.162881 28185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:02.163189 28185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:02.164399 28185 hybrid_clock.cc:648] HybridClock initialized: now 1786395902164384 us; error 52 us; skew 500 ppm
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395902, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:05:02.167371 28185 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:05:02.167905 28185 webserver.cc:460] Webserver started at http://127.15.37.1:43437/ using document root <none> and password file <none>
I20260810 21:05:02.168202 28185 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:02.168283 28185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:02.168466 28185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:02.169664 28185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "09872000a7f64300b15728e914e41992"
format_stamp: "Formatted at 2026-08-10 21:05:02 on dist-test-slave-jq4t"
server_key: "101771a3893d3ec07a2b5380c4644f93"
server_key_iv: "69edb0aaac237ab7d61883ba8e6204d1"
server_key_version: "encryptionkey@0"
I20260810 21:05:02.170074 28185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "09872000a7f64300b15728e914e41992"
format_stamp: "Formatted at 2026-08-10 21:05:02 on dist-test-slave-jq4t"
server_key: "101771a3893d3ec07a2b5380c4644f93"
server_key_iv: "69edb0aaac237ab7d61883ba8e6204d1"
server_key_version: "encryptionkey@0"
I20260810 21:05:02.171631 28185 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:05:02.172565 28208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:02.172794 28185 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:05:02.172909 28185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "09872000a7f64300b15728e914e41992"
format_stamp: "Formatted at 2026-08-10 21:05:02 on dist-test-slave-jq4t"
server_key: "101771a3893d3ec07a2b5380c4644f93"
server_key_iv: "69edb0aaac237ab7d61883ba8e6204d1"
server_key_version: "encryptionkey@0"
I20260810 21:05:02.173027 28185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:02.187155 28185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:02.189939 28185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:02.190147 28185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:02.190460 28185 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:02.190850 28185 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:02.190910 28185 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:02.190950 28185 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:02.190999 28185 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:02.197722 28185 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:37403
I20260810 21:05:02.197775 28392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:37403 every 8 connection(s)
I20260810 21:05:02.198176 28185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395902, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:05:02.206758 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 28185
I20260810 21:05:02.206897 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:05:02.207165 15508 external_mini_cluster.cc:1428] Setting key 3a3d5b89a31714ea500179aaee4e65b9
I20260810 21:05:02.211364 28153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:02.199168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:47869 (local address 127.15.37.62:42197)
0810 21:05:02.199241 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:02.199243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:02.199474 (+ 231us) server_negotiation.cc:407] Connection header received
0810 21:05:02.200004 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:02.200005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:02.200018 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:02.200096 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:02.201364 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.201936 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.203323 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.203563 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.203636 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:02.206681 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:02.206684 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:02.206684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:05:02.206703 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:02.209181 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:02.209746 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:02.209748 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:02.209748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:02.209825 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:02.210347 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:02.210348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:02.210349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:02.210513 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:02.210574 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:02.211072 (+ 498us) server_negotiation.cc:299] Negotiation successful
0810 21:05:02.211233 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 21:05:02.211623 28398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:02.199078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:47869)
0810 21:05:02.199285 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:02.199333 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:02.199868 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:02.200235 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:02.200240 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:02.200991 (+ 751us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:02.201221 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:02.201226 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.202076 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.202078 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:02.203090 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:02.203094 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.203801 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.203802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:02.203953 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:02.204692 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:02.204703 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:02.206519 (+ 1816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:05:02.209305 (+ 2786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:05:02.209319 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:05:02.209322 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:05:02.209653 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:05:02.209968 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:05:02.209970 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:05:02.209970 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:05:02.210221 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:05:02.210599 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:05:02.210610 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:05:02.210869 (+ 259us) client_negotiation.cc:769] Sending connection context
0810 21:05:02.211020 (+ 151us) client_negotiation.cc:240] Negotiation successful
0810 21:05:02.211277 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":99,"threads_started":1}
I20260810 21:05:02.212392 28396 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42197
I20260810 21:05:02.212568 28396 heartbeater.cc:464] Registering TS with master...
I20260810 21:05:02.212824 28396 heartbeater.cc:511] Master 127.15.37.62:42197 requested a full tablet report, sending...
I20260810 21:05:02.213585 28090 ts_manager.cc:194] Registered new tserver with Master: 09872000a7f64300b15728e914e41992 (127.15.37.1:37403)
I20260810 21:05:02.214880 28090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:47869
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:05:02.240796 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42197
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:05:02.326611 28401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:02.326840 28401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:02.326867 28401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:02.328137 28401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:02.328192 28401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:02.328222 28401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:05:02.329836 28401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:02.330137 28401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:02.330426 28401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:02.336051 28418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:02.336041 28411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:02.336035 28415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:02.336432 28401 server_base.cc:1034] running on GCE node
I20260810 21:05:02.336726 28401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:02.337023 28401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:02.338250 28401 hybrid_clock.cc:648] HybridClock initialized: now 1786395902338233 us; error 32 us; skew 500 ppm
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395902, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:05:02.341200 28401 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:05:02.341665 28401 webserver.cc:460] Webserver started at http://127.15.37.2:41009/ using document root <none> and password file <none>
I20260810 21:05:02.341928 28401 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:02.341979 28401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:02.342082 28401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:02.343314 28401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "e72cb2ecb7dd4f14bcfe633300c74ab9"
format_stamp: "Formatted at 2026-08-10 21:05:02 on dist-test-slave-jq4t"
server_key: "f43a1d2dd009ae62c81d5e41e6abcf48"
server_key_iv: "00be04dc3d86db4bc2f48827e18bc375"
server_key_version: "encryptionkey@0"
I20260810 21:05:02.343676 28401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "e72cb2ecb7dd4f14bcfe633300c74ab9"
format_stamp: "Formatted at 2026-08-10 21:05:02 on dist-test-slave-jq4t"
server_key: "f43a1d2dd009ae62c81d5e41e6abcf48"
server_key_iv: "00be04dc3d86db4bc2f48827e18bc375"
server_key_version: "encryptionkey@0"
I20260810 21:05:02.345291 28401 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:05:02.346125 28431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:02.346377 28401 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:05:02.346482 28401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "e72cb2ecb7dd4f14bcfe633300c74ab9"
format_stamp: "Formatted at 2026-08-10 21:05:02 on dist-test-slave-jq4t"
server_key: "f43a1d2dd009ae62c81d5e41e6abcf48"
server_key_iv: "00be04dc3d86db4bc2f48827e18bc375"
server_key_version: "encryptionkey@0"
I20260810 21:05:02.346563 28401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:02.358835 28401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:02.361726 28401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:02.361871 28401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:02.362236 28401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:02.362604 28401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:02.362643 28401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:02.362690 28401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:02.362720 28401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:02.370345 28401 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:42229
I20260810 21:05:02.370424 28602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:42229 every 8 connection(s)
I20260810 21:05:02.371191 28401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:05:02.377446 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 28401
I20260810 21:05:02.377629 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:05:02.377949 15508 external_mini_cluster.cc:1428] Setting key de103707fa238448e237746bcc81e562
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395902, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:05:02.384171 28153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:02.372458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:35351 (local address 127.15.37.62:42197)
0810 21:05:02.372630 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:02.372633 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:02.372882 (+ 249us) server_negotiation.cc:407] Connection header received
0810 21:05:02.373415 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:02.373417 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:02.373430 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:02.373504 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:02.374613 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.375250 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.376604 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.376823 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.376918 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:02.379934 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:02.379936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:02.379936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:05:02.379948 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:02.381810 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:02.382413 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:02.382415 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:02.382415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:02.382598 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:02.383052 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:02.383055 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:02.383056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:02.383336 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:02.383457 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:02.383967 (+ 510us) server_negotiation.cc:299] Negotiation successful
0810 21:05:02.384089 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260810 21:05:02.384624 28605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:02.372382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:35351)
0810 21:05:02.372710 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:02.372757 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:02.373285 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:02.373593 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:02.373598 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:02.374259 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:02.374484 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:02.374489 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.375389 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.375390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:02.376455 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:02.376459 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.376919 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.376920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:02.377103 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:02.377847 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:02.377860 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:02.379813 (+ 1953us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:05:02.381928 (+ 2115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:05:02.381942 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:05:02.381946 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:05:02.382302 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:05:02.382690 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:05:02.382691 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:05:02.382691 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:05:02.382862 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:05:02.383469 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:05:02.383478 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:05:02.383704 (+ 226us) client_negotiation.cc:769] Sending connection context
0810 21:05:02.383866 (+ 162us) client_negotiation.cc:240] Negotiation successful
0810 21:05:02.384122 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":156,"threads_started":1}
I20260810 21:05:02.385358 28603 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42197
I20260810 21:05:02.385514 28603 heartbeater.cc:464] Registering TS with master...
I20260810 21:05:02.385746 28603 heartbeater.cc:511] Master 127.15.37.62:42197 requested a full tablet report, sending...
I20260810 21:05:02.386569 28090 ts_manager.cc:194] Registered new tserver with Master: e72cb2ecb7dd4f14bcfe633300c74ab9 (127.15.37.2:42229)
I20260810 21:05:02.387074 28090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:35351
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:05:02.412439 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42197
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:05:02.501909 28611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:02.502172 28611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:02.502211 28611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:02.503433 28611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:02.503505 28611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:02.503553 28611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:05:02.505187 28611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:02.505486 28611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:02.505738 28611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:02.511315 28624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:02.511307 28621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:02.511307 28620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:02.511351 28611 server_base.cc:1034] running on GCE node
I20260810 21:05:02.511792 28611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:02.512030 28611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:02.513219 28611 hybrid_clock.cc:648] HybridClock initialized: now 1786395902513214 us; error 44 us; skew 500 ppm
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395902, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:05:02.515951 28611 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:05:02.516448 28611 webserver.cc:460] Webserver started at http://127.15.37.3:38423/ using document root <none> and password file <none>
I20260810 21:05:02.516746 28611 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:02.516825 28611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:02.516992 28611 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:02.518116 28611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "ffa7927542c94591bb0439de5912db3c"
format_stamp: "Formatted at 2026-08-10 21:05:02 on dist-test-slave-jq4t"
server_key: "24a65a6fd56b27093afb30fdb2877e69"
server_key_iv: "e4dbf683becdcb0e1c2a5c87297a94e0"
server_key_version: "encryptionkey@0"
I20260810 21:05:02.518559 28611 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "ffa7927542c94591bb0439de5912db3c"
format_stamp: "Formatted at 2026-08-10 21:05:02 on dist-test-slave-jq4t"
server_key: "24a65a6fd56b27093afb30fdb2877e69"
server_key_iv: "e4dbf683becdcb0e1c2a5c87297a94e0"
server_key_version: "encryptionkey@0"
I20260810 21:05:02.520054 28611 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:05:02.521001 28633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:02.521309 28611 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 21:05:02.521435 28611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "ffa7927542c94591bb0439de5912db3c"
format_stamp: "Formatted at 2026-08-10 21:05:02 on dist-test-slave-jq4t"
server_key: "24a65a6fd56b27093afb30fdb2877e69"
server_key_iv: "e4dbf683becdcb0e1c2a5c87297a94e0"
server_key_version: "encryptionkey@0"
I20260810 21:05:02.521529 28611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:02.537561 28611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:02.539839 28611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:02.540026 28611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:02.540294 28611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:02.540669 28611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:02.540728 28611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:02.540773 28611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:02.540802 28611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:02.547148 28611 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:34367
I20260810 21:05:02.547197 28819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:34367 every 8 connection(s)
I20260810 21:05:02.547575 28611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:05:02.549023 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 28611
I20260810 21:05:02.549121 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:05:02.549324 15508 external_mini_cluster.cc:1428] Setting key 0e8c7045ff410d2310d11ad798ad5443
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395902, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:05:02.557865 28153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:02.548395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:46293 (local address 127.15.37.62:42197)
0810 21:05:02.548517 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:02.548519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:02.548723 (+ 204us) server_negotiation.cc:407] Connection header received
0810 21:05:02.549457 (+ 734us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:02.549458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:02.549473 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:02.549542 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:02.550811 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.551350 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.552498 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.552700 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.552789 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:02.555158 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:02.555159 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:02.555160 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:05:02.555168 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:02.556403 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:02.556838 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:02.556840 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:02.556840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:02.556906 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:02.557163 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:02.557165 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:02.557165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:02.557300 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:02.557383 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:02.557678 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 21:05:02.557766 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 21:05:02.558110 28824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:02.548355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:46293)
0810 21:05:02.548589 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:02.548633 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:02.549300 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:02.549647 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:02.549654 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:02.550437 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:02.550714 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:02.550719 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.551499 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.551500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:02.552377 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:02.552379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.552800 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.552801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:02.552943 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:02.553480 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:02.553490 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:02.555054 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:05:02.556513 (+ 1459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:05:02.556520 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:05:02.556523 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:05:02.556757 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:05:02.556979 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:05:02.556979 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:05:02.556980 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:05:02.557093 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:05:02.557371 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:05:02.557378 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:05:02.557535 (+ 157us) client_negotiation.cc:769] Sending connection context
0810 21:05:02.557653 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 21:05:02.557825 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":154,"threads_started":1}
I20260810 21:05:02.558740 28820 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42197
I20260810 21:05:02.558852 28820 heartbeater.cc:464] Registering TS with master...
I20260810 21:05:02.559055 28820 heartbeater.cc:511] Master 127.15.37.62:42197 requested a full tablet report, sending...
I20260810 21:05:02.559513 28090 ts_manager.cc:194] Registered new tserver with Master: ffa7927542c94591bb0439de5912db3c (127.15.37.3:34367)
I20260810 21:05:02.559909 28090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:46293
I20260810 21:05:02.561189 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab.
Entry for principal oryx/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab.
WARNING: no policy specified for oryx/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab.
Entry for principal oryx/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab.
WARNING: no policy specified for oryx/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab.
Entry for principal oryx/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab.
I20260810 21:05:02.652269 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 28185
I20260810 21:05:02.660794 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 28401
I20260810 21:05:02.675362 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 28611
I20260810 21:05:02.697952 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 28035
I20260810 21:05:02.708809 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:42197
--webserver_interface=127.15.37.62
--webserver_port=39291
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:42197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:05:02.794159 28839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:02.794384 28839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:02.794415 28839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:02.795535 28839 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:05:02.795583 28839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:02.795598 28839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:02.795609 28839 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:05:02.795621 28839 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:05:02.797093 28839 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:42197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:42197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=39291
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:02.797308 28839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:02.797506 28839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:02.802843 28854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:02.802850 28853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:02.802888 28839 server_base.cc:1034] running on GCE node
W20260810 21:05:02.802884 28856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:02.803352 28839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:02.803687 28839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:02.804842 28839 hybrid_clock.cc:648] HybridClock initialized: now 1786395902804822 us; error 47 us; skew 500 ppm
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395902, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:05:02.807493 28839 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:05:02.808010 28839 webserver.cc:460] Webserver started at http://127.15.37.62:39291/ using document root <none> and password file <none>
I20260810 21:05:02.808252 28839 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:02.808331 28839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:02.809882 28839 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:05:02.810691 28866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:02.811017 28839 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:05:02.811120 28839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "229f53f1ed0c4a49a75ccae22ed65ce5"
format_stamp: "Formatted at 2026-08-10 21:05:01 on dist-test-slave-jq4t"
server_key: "3b5093c7d68e8ff7e99b83ee809fd3a1"
server_key_iv: "7f88dd156fd28e725d1927ba73e98250"
server_key_version: "encryptionkey@0"
I20260810 21:05:02.811486 28839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:02.830276 28839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:02.832924 28839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:02.833053 28839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:02.837337 28839 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:42197
I20260810 21:05:02.837402 28947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:42197 every 8 connection(s)
I20260810 21:05:02.837833 28839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:05:02.839469 28949 sys_catalog.cc:263] Verifying existing consensus state
I20260810 21:05:02.840206 28949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5: Bootstrap starting.
I20260810 21:05:02.844712 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 28839
I20260810 21:05:02.845130 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:37403
--local_ip_for_outbound_sockets=127.15.37.1
--tserver_master_addrs=127.15.37.62:42197
--webserver_port=43437
--webserver_interface=127.15.37.1
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.37.1
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:05:02.850622 28949 log.cc:824] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5: Log is configured to *not* fsync() on all Append() calls
I20260810 21:05:02.852666 28949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 21:05:02.853003 28949 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5: Bootstrap complete.
I20260810 21:05:02.855463 28949 raft_consensus.cc:348] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42197 } }
I20260810 21:05:02.855809 28949 raft_consensus.cc:729] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 229f53f1ed0c4a49a75ccae22ed65ce5, State: Initialized, Role: FOLLOWER
I20260810 21:05:02.856048 28949 consensus_queue.cc:260] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42197 } }
I20260810 21:05:02.856159 28949 raft_consensus.cc:388] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:05:02.856216 28949 raft_consensus.cc:482] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:05:02.856266 28949 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 1 FOLLOWER]: Advancing to term 2
I20260810 21:05:02.857475 28949 raft_consensus.cc:504] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42197 } }
I20260810 21:05:02.857606 28949 leader_election.cc:302] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 229f53f1ed0c4a49a75ccae22ed65ce5; no voters:
I20260810 21:05:02.857836 28949 leader_election.cc:288] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 21:05:02.857877 28955 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 21:05:02.858022 28955 raft_consensus.cc:686] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [term 2 LEADER]: Becoming Leader. State: Replica: 229f53f1ed0c4a49a75ccae22ed65ce5, State: Running, Role: LEADER
I20260810 21:05:02.858145 28949 sys_catalog.cc:564] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:05:02.858232 28955 consensus_queue.cc:237] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42197 } }
I20260810 21:05:02.858520 28955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 229f53f1ed0c4a49a75ccae22ed65ce5. Latest consensus state: current_term: 2 leader_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42197 } } }
I20260810 21:05:02.858682 28955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:05:02.858527 28956 sys_catalog.cc:455] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229f53f1ed0c4a49a75ccae22ed65ce5" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42197 } } }
I20260810 21:05:02.858857 28956 sys_catalog.cc:458] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:05:02.859309 28969 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:05:02.859913 28969 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:05:02.860118 28969 catalog_manager.cc:1259] Loaded cluster ID: 3771399a9d1a407ba010500e78737182
I20260810 21:05:02.860286 28969 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:05:02.861490 28969 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:05:02.861668 28969 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 229f53f1ed0c4a49a75ccae22ed65ce5: Loaded TSK: 0
I20260810 21:05:02.861876 28969 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 21:05:02.934902 28952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:02.935158 28952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:02.935184 28952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:02.936379 28952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:02.936425 28952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:02.936453 28952 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:05:02.938110 28952 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.1.keytab
--principal=oryx/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:37403
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=43437
--tserver_master_addrs=127.15.37.62:42197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:02.938377 28952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:02.938634 28952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:02.945011 28992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:02.945111 28991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:02.945210 28952 server_base.cc:1034] running on GCE node
W20260810 21:05:02.945012 28994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:02.945549 28952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:02.945863 28952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:02.947050 28952 hybrid_clock.cc:648] HybridClock initialized: now 1786395902947004 us; error 57 us; skew 500 ppm
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395902, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:05:02.950313 28952 init.cc:377] Logged in from keytab as oryx/127.15.37.1@KRBTEST.COM (short username oryx)
I20260810 21:05:02.950888 28952 webserver.cc:460] Webserver started at http://127.15.37.1:43437/ using document root <none> and password file <none>
I20260810 21:05:02.951202 28952 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:02.951273 28952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:02.952840 28952 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 21:05:02.953548 29005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:02.953758 28952 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:05:02.953873 28952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "09872000a7f64300b15728e914e41992"
format_stamp: "Formatted at 2026-08-10 21:05:02 on dist-test-slave-jq4t"
server_key: "101771a3893d3ec07a2b5380c4644f93"
server_key_iv: "69edb0aaac237ab7d61883ba8e6204d1"
server_key_version: "encryptionkey@0"
I20260810 21:05:02.954282 28952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:02.964975 28952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:02.967625 28952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:02.967839 28952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:02.968138 28952 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:02.968569 28952 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:02.968628 28952 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:02.968676 28952 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:02.968703 28952 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:02.978984 28952 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:37403
I20260810 21:05:02.979458 29182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:37403 every 8 connection(s)
I20260810 21:05:02.979645 28952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:05:02.981793 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 28952
I20260810 21:05:02.982156 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:42229
--local_ip_for_outbound_sockets=127.15.37.2
--tserver_master_addrs=127.15.37.62:42197
--webserver_port=41009
--webserver_interface=127.15.37.2
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.37.2
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:02.991694 29187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:02.980886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:57403)
0810 21:05:02.981102 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:02.981162 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:02.981696 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:02.982201 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:02.982205 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:02.982852 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:02.983072 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:02.983078 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.984810 (+ 1732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.984811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:02.986259 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:02.986264 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.987243 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.987245 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:02.987397 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:02.988112 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:02.988123 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:02.991390 (+ 3267us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":92,"threads_started":1}
W20260810 21:05:02.992012 29183 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:42197 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.37.62:42197: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
W20260810 21:05:02.992167 29189 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:02.981032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:57403 (local address 127.15.37.62:42197)
0810 21:05:02.981269 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:02.981279 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:02.981325 (+ 46us) server_negotiation.cc:407] Connection header received
0810 21:05:02.981948 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:02.981954 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:02.982000 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:02.982141 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:02.983214 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.984658 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.986390 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.987117 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.987254 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:02.991618 (+ 4364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:57403: BlockingRecv error: recv got EOF from 127.15.37.1:57403 (error 108)
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":97,"threads_started":1}
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:02.998549 29187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:02.992288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:47537)
0810 21:05:02.992695 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:02.992709 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:02.992775 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:02.992957 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:02.992958 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:02.993147 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:02.993222 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:02.993224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.994081 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.994083 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:02.995031 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:02.995035 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.995628 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.995630 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:02.995737 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:02.996258 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:02.996262 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:02.998464 (+ 2202us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":118,"threads_started":1}
W20260810 21:05:02.998704 29189 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:02.992615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:47537 (local address 127.15.37.62:42197)
0810 21:05:02.992682 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:02.992684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:02.992768 (+ 84us) server_negotiation.cc:407] Connection header received
0810 21:05:02.992839 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:02.992840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:02.992855 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:02.992929 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:02.993311 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.993984 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.995150 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:02.995492 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:02.995564 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:02.998616 (+ 3052us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:47537: BlockingRecv error: recv got EOF from 127.15.37.1:47537 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:02 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:03.003803 29192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:02.998827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:40039)
0810 21:05:02.998911 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:02.998925 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:02.998982 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:02.999309 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:02.999310 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:02.999473 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:02.999522 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:02.999524 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.000180 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.000181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.000811 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:03.000813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.001237 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.001238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.001304 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.001831 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:03.001836 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:03.003734 (+ 1898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 21:05:03.003984 29189 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:02.999116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:40039 (local address 127.15.37.62:42197)
0810 21:05:02.999174 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:02.999175 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:02.999183 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:05:02.999215 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:02.999215 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:02.999225 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:02.999287 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:02.999611 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.000097 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.000941 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.001136 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.001216 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.003851 (+ 2635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:40039: BlockingRecv error: recv got EOF from 127.15.37.1:40039 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260810 21:05:03.003980 29183 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 21:05:03.075014 29191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:03.075253 29191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:03.075280 29191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:03.076455 29191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:03.076527 29191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:03.076556 29191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:05:03.078025 29191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.2.keytab
--principal=oryx/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:42229
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=41009
--tserver_master_addrs=127.15.37.62:42197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:03.078298 29191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:03.078547 29191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:03.083884 29199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:03.083884 29203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:03.083876 29198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:03.084149 29191 server_base.cc:1034] running on GCE node
I20260810 21:05:03.084394 29191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:03.084712 29191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:03.085872 29191 hybrid_clock.cc:648] HybridClock initialized: now 1786395903085859 us; error 31 us; skew 500 ppm
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395903, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:05:03.088884 29191 init.cc:377] Logged in from keytab as oryx/127.15.37.2@KRBTEST.COM (short username oryx)
I20260810 21:05:03.089388 29191 webserver.cc:460] Webserver started at http://127.15.37.2:41009/ using document root <none> and password file <none>
I20260810 21:05:03.089633 29191 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:03.089692 29191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:03.091203 29191 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:05:03.091833 29215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:03.092023 29191 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 21:05:03.092105 29191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "e72cb2ecb7dd4f14bcfe633300c74ab9"
format_stamp: "Formatted at 2026-08-10 21:05:02 on dist-test-slave-jq4t"
server_key: "f43a1d2dd009ae62c81d5e41e6abcf48"
server_key_iv: "00be04dc3d86db4bc2f48827e18bc375"
server_key_version: "encryptionkey@0"
I20260810 21:05:03.092651 29191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:03.121258 29191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:03.123503 29191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:03.123643 29191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:03.123874 29191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:03.124258 29191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:03.124298 29191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:03.124332 29191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:03.124390 29191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:03.131001 29191 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:42229
I20260810 21:05:03.131044 29367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:42229 every 8 connection(s)
I20260810 21:05:03.131500 29191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:03.139510 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 29191
W20260810 21:05:03.139762 29189 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:03.132444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:46127 (local address 127.15.37.62:42197)
0810 21:05:03.132558 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:03.132561 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:03.132759 (+ 198us) server_negotiation.cc:407] Connection header received
0810 21:05:03.133352 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:03.133353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:03.133373 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:03.133429 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:03.134492 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.135019 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.136096 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.136300 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.136400 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.139709 (+ 3309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:46127: BlockingRecv error: recv got EOF from 127.15.37.2:46127 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260810 21:05:03.139846 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:34367
--local_ip_for_outbound_sockets=127.15.37.3
--tserver_master_addrs=127.15.37.62:42197
--webserver_port=38423
--webserver_interface=127.15.37.3
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.15.37.3
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:05:03.139819 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:03.132384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:46127)
0810 21:05:03.132617 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:03.132666 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:03.133226 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:03.133519 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:03.133525 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:03.134163 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:03.134379 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:03.134384 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.135132 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.135134 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.135992 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:03.135994 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.136415 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.136416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.136567 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.137166 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:03.137175 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:03.139568 (+ 2393us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":139,"threads_started":1}
W20260810 21:05:03.140130 29371 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:42197 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.37.62:42197: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:03.146961 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:03.140355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:46719)
0810 21:05:03.140419 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:03.140431 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:03.140515 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:03.141893 (+ 1378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:03.141894 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:03.142064 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:03.142131 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:03.142133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.142907 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.142908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.143465 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:03.143467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.144057 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.144059 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.144131 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.144764 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:03.144772 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:03.146906 (+ 2134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260810 21:05:03.147158 29189 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:03.141695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:46719 (local address 127.15.37.62:42197)
0810 21:05:03.141753 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:03.141755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:03.141764 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:05:03.141798 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:03.141799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:03.141807 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:03.141855 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:03.142245 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.142817 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.143577 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.143951 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.144038 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.147058 (+ 3020us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:46719: BlockingRecv error: recv got EOF from 127.15.37.2:46719 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:03.152124 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:03.147243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:48755)
0810 21:05:03.147398 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:03.147408 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:03.147461 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:03.147631 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:03.147632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:03.147740 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:03.147771 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:03.147772 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.148867 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.148868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.149337 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:03.149338 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.149910 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.149911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.149951 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.150404 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:03.150408 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:03.152070 (+ 1662us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":99,"threads_started":1}
W20260810 21:05:03.152292 29189 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:03.147379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:48755 (local address 127.15.37.62:42197)
0810 21:05:03.147420 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:03.147422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:03.147455 (+ 33us) server_negotiation.cc:407] Connection header received
0810 21:05:03.147536 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:03.147537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:03.147550 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:03.147623 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:03.147853 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.148760 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.149437 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.149811 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.149909 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.152205 (+ 2296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:48755: BlockingRecv error: recv got EOF from 127.15.37.2:48755 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 21:05:03.152467 29371 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 21:05:03.232754 29378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:03.232983 29378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:03.233009 29378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:03.234182 29378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:03.234225 29378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:03.234251 29378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:05:03.235723 29378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/krb5kdc/oryx_127.15.37.3.keytab
--principal=oryx/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:34367
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=38423
--tserver_master_addrs=127.15.37.62:42197
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:03.235965 29378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:03.236219 29378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:03.241725 29392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:03.241741 29396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:03.241998 29378 server_base.cc:1034] running on GCE node
W20260810 21:05:03.241747 29391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:03.242293 29378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:03.242534 29378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:03.243674 29378 hybrid_clock.cc:648] HybridClock initialized: now 1786395903243660 us; error 30 us; skew 500 ppm
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395903, etypes {rep=17 tkt=17 ses=17}, oryx/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:05:03.246284 29378 init.cc:377] Logged in from keytab as oryx/127.15.37.3@KRBTEST.COM (short username oryx)
I20260810 21:05:03.246790 29378 webserver.cc:460] Webserver started at http://127.15.37.3:38423/ using document root <none> and password file <none>
I20260810 21:05:03.247036 29378 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:03.247139 29378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:03.248636 29378 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:05:03.249325 29408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:03.249513 29378 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:05:03.249620 29378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "ffa7927542c94591bb0439de5912db3c"
format_stamp: "Formatted at 2026-08-10 21:05:02 on dist-test-slave-jq4t"
server_key: "24a65a6fd56b27093afb30fdb2877e69"
server_key_iv: "e4dbf683becdcb0e1c2a5c87297a94e0"
server_key_version: "encryptionkey@0"
I20260810 21:05:03.250015 29378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:03.274178 29378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:03.276643 29378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:03.276834 29378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:03.277133 29378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:03.277495 29378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:03.277556 29378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:03.277599 29378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:03.277630 29378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:03.283861 29378 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:34367
I20260810 21:05:03.283916 29587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:34367 every 8 connection(s)
I20260810 21:05:03.284327 29378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:05:03.287246 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 29378
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
W20260810 21:05:03.292613 29189 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:03.285193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:42693 (local address 127.15.37.62:42197)
0810 21:05:03.285272 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:03.285275 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:03.285507 (+ 232us) server_negotiation.cc:407] Connection header received
0810 21:05:03.285975 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:03.285976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:03.285987 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:03.286039 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:03.287005 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.287631 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.288861 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.289150 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.289221 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.292546 (+ 3325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:42693: BlockingRecv error: recv got EOF from 127.15.37.3:42693 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 21:05:03.292698 29593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:03.285182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:42693)
0810 21:05:03.285367 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:03.285410 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:03.285880 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:03.286095 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:03.286098 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:03.286715 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:03.286921 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:03.286926 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.287735 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.287737 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.288780 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:03.288783 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.289233 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.289234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.289341 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.289968 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:03.289977 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:03.292415 (+ 2438us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":102,"threads_started":1}
W20260810 21:05:03.292966 29588 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:42197 (0 consecutive failures): Not authorized: Failed to ping master at 127.15.37.62:42197: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
I20260810 21:05:03.295547 29597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:03.287801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41832 (local address 127.15.37.62:42197)
0810 21:05:03.287941 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:03.287942 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:03.287951 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:05:03.287976 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:03.287977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:03.287989 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:03.288042 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:03.288753 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.289438 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.290212 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.290428 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.290508 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.291980 (+ 1472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:03.291985 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:03.291985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:05:03.291998 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:03.294010 (+ 2012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:03.294403 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:03.294407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:03.294407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:03.294521 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:03.294733 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:03.294734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:03.294734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:03.294988 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:03.295156 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:03.295260 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 21:05:03.295375 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:03.297677 29593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:03.293223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:54677)
0810 21:05:03.293369 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:03.293379 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:03.293454 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:03.293611 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:03.293612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:03.293744 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:03.293793 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:03.293795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.294432 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.294433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.294963 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:03.294964 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.295336 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.295337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.295407 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.295828 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:03.295833 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:03.297630 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132}
W20260810 21:05:03.297856 29189 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:03.293261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:54677 (local address 127.15.37.62:42197)
0810 21:05:03.293312 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:03.293314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:03.293439 (+ 125us) server_negotiation.cc:407] Connection header received
0810 21:05:03.293513 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:03.293515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:03.293524 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:03.293604 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:03.293870 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.294336 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.295065 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.295249 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.295333 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.297782 (+ 2449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:54677: BlockingRecv error: recv got EOF from 127.15.37.3:54677 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:03 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:03.301743 29593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:03.298052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:57939)
0810 21:05:03.298091 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:03.298102 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:03.298147 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:03.298320 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:03.298320 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:03.298426 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:03.298456 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:03.298456 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.299043 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.299043 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.299515 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:03.299516 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.299813 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.299813 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:03.299850 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.300184 (+ 334us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:03.300188 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:03.301699 (+ 1511us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":23}
W20260810 21:05:03.301837 29189 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:03.298149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:57939 (local address 127.15.37.62:42197)
0810 21:05:03.298224 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:03.298226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:03.298236 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:05:03.298260 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:03.298261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:03.298268 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:03.298315 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:03.298515 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.298976 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.299582 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:03.299753 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:03.299799 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:03.301778 (+ 1979us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:57939: BlockingRecv error: recv got EOF from 127.15.37.3:57939 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260810 21:05:03.301952 29588 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 21:05:04 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:04 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:04.009651 29598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:04.004425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:48683)
0810 21:05:04.004579 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:04.004591 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:04.004657 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:04.004837 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:04.004838 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:04.005036 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:04.005092 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:04.005094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:04.005910 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:04.005912 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:04.006545 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:04.006546 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:04.006949 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:04.006951 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:04.007036 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:04.007536 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:04.007541 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:04.009584 (+ 2043us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
W20260810 21:05:04.009935 29599 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:04.004528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:48683 (local address 127.15.37.62:42197)
0810 21:05:04.004690 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:04.004692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:04.004701 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:05:04.004738 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:04.004739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:04.004750 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:04.004817 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:04.005210 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:04.005766 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:04.006639 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:04.006845 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:04.006900 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:04.009842 (+ 2942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:48683: BlockingRecv error: recv got EOF from 127.15.37.1:48683 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":97,"threads_started":1}
Aug 10 21:05:04 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:04 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:04.158346 29601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:04.152961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:48153)
0810 21:05:04.153171 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:04.153182 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:04.153239 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:04.153444 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:04.153446 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:04.153646 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:04.153703 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:04.153705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:04.154465 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:04.154466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:04.155037 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:04.155039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:04.155398 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:04.155399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:04.155454 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:04.156046 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:04.156072 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:04.158191 (+ 2119us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":122,"threads_started":1}
W20260810 21:05:04.158411 29599 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:04.153171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:48153 (local address 127.15.37.62:42197)
0810 21:05:04.153252 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:04.153254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:04.153291 (+ 37us) server_negotiation.cc:407] Connection header received
0810 21:05:04.153323 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:04.153324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:04.153338 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:04.153387 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:04.153791 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:04.154382 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:04.155123 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:04.155313 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:04.155365 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:04.158335 (+ 2970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:48153: BlockingRecv error: recv got EOF from 127.15.37.2:48153 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 10 21:05:04 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:04 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:04.307029 29603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:04.302361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:43705)
0810 21:05:04.302496 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:04.302507 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:04.302556 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:04.302694 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:04.302695 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:04.302891 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:04.302946 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:04.302947 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:04.303595 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:04.303596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:04.304168 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:04.304170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:04.304584 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:04.304585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:04.304630 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:04.305127 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:04.305131 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:04.306933 (+ 1802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":74,"threads_started":1}
W20260810 21:05:04.307245 29599 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:04.302452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:43705 (local address 127.15.37.62:42197)
0810 21:05:04.302537 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:04.302538 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:04.302548 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:05:04.302618 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:04.302619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:04.302634 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:04.302690 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:04.303011 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:04.303516 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:04.304276 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:04.304469 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:04.304560 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:04.307063 (+ 2503us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:43705: BlockingRecv error: recv got EOF from 127.15.37.3:43705 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 10 21:05:05 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:05 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:05.015852 29604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:05.010233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:59483)
0810 21:05:05.010430 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:05.010442 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:05.010498 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:05.010632 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:05.010633 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:05.010828 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:05.010889 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:05.010891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:05.011719 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:05.011720 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:05.012286 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:05.012288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:05.012793 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:05.012794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:05.012854 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:05.013416 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:05.013421 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:05.015746 (+ 2325us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":133,"threads_started":1}
W20260810 21:05:05.015938 29607 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:05.010373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:59483 (local address 127.15.37.62:42197)
0810 21:05:05.010500 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:05.010502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:05.010532 (+ 30us) server_negotiation.cc:407] Connection header received
0810 21:05:05.010557 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:05.010558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:05.010571 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:05.010626 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:05.010996 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:05.011619 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:05.012397 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:05.012705 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:05.012772 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:05.015859 (+ 3087us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:59483: BlockingRecv error: recv got EOF from 127.15.37.1:59483 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":61,"threads_started":1}
Aug 10 21:05:05 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:05 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:05.164155 29608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:05.158910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:41839)
0810 21:05:05.159121 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:05.159142 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:05.159205 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:05.159356 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:05.159357 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:05.159537 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:05.159591 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:05.159594 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:05.160382 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:05.160384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:05.160965 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:05.160968 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:05.161501 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:05.161502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:05.161561 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:05.162169 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:05.162174 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:05.164084 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":144,"threads_started":1}
W20260810 21:05:05.164307 29607 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:05.159028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:41839 (local address 127.15.37.62:42197)
0810 21:05:05.159134 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:05.159136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:05.159190 (+ 54us) server_negotiation.cc:407] Connection header received
0810 21:05:05.159257 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:05.159258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:05.159271 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:05.159331 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:05.159678 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:05.160291 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:05.161141 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:05.161394 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:05.161464 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:05.164223 (+ 2759us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:41839: BlockingRecv error: recv got EOF from 127.15.37.2:41839 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 10 21:05:05 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:05 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:05.312968 29610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:05.307795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:49867)
0810 21:05:05.307991 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:05.308029 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:05.308091 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:05.308272 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:05.308273 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:05.308529 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:05.308594 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:05.308596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:05.309316 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:05.309318 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:05.309860 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:05.309862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:05.310235 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:05.310236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:05.310295 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:05.310898 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:05.310908 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:05.312856 (+ 1948us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":131,"threads_started":1}
W20260810 21:05:05.313007 29607 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:05.307967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:49867 (local address 127.15.37.62:42197)
0810 21:05:05.308061 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:05.308063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:05.308095 (+ 32us) server_negotiation.cc:407] Connection header received
0810 21:05:05.308170 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:05.308171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:05.308189 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:05.308262 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:05.308685 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:05.309212 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:05.309955 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:05.310156 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:05.310237 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:05.312941 (+ 2704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:49867: BlockingRecv error: recv got EOF from 127.15.37.3:49867 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 10 21:05:06 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:06 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:06.022379 29611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:06.016527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:54053)
0810 21:05:06.016713 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:06.016725 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:06.016791 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:06.016965 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:06.016965 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:06.017151 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:06.017205 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:06.017207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:06.018044 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:06.018045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:06.018606 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:06.018608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:06.019145 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:06.019146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:06.019206 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:06.019882 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:06.019888 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:06.022312 (+ 2424us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":115,"threads_started":1}
W20260810 21:05:06.022558 29614 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:06.016642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:54053 (local address 127.15.37.62:42197)
0810 21:05:06.016816 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:06.016818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:06.016828 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:05:06.016864 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:06.016864 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:06.016879 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:06.016949 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:06.017303 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:06.017932 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:06.018719 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:06.018973 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:06.019043 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:06.022450 (+ 3407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:54053: BlockingRecv error: recv got EOF from 127.15.37.1:54053 (error 108)
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":100,"threads_started":1}
Aug 10 21:05:06 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:06 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:06.169955 29616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:06.164743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:39131)
0810 21:05:06.164879 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:06.164894 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:06.164971 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:06.165144 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:06.165145 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:06.165338 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:06.165389 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:06.165391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:06.166135 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:06.166136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:06.166695 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:06.166697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:06.167230 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:06.167232 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:06.167311 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:06.167903 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:06.167907 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:06.169874 (+ 1967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
W20260810 21:05:06.170039 29614 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:06.164850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:39131 (local address 127.15.37.62:42197)
0810 21:05:06.164906 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:06.164908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:06.164953 (+ 45us) server_negotiation.cc:407] Connection header received
0810 21:05:06.165050 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:06.165051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:06.165064 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:06.165120 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:06.165487 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:06.166045 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:06.166809 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:06.167098 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:06.167184 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:06.169990 (+ 2806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:39131: BlockingRecv error: recv got EOF from 127.15.37.2:39131 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 10 21:05:06 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:06 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:06.318722 29617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:06.313510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:46739)
0810 21:05:06.313699 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:06.313711 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:06.313803 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:06.313969 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:06.313970 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:06.314162 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:06.314213 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:06.314214 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:06.314926 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:06.314927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:06.315510 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:06.315512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:06.315878 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:06.315879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:06.315939 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:06.316579 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:06.316583 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:06.318610 (+ 2027us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":110,"threads_started":1}
W20260810 21:05:06.318791 29614 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:06.313608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:46739 (local address 127.15.37.62:42197)
0810 21:05:06.313687 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:06.313690 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:06.313781 (+ 91us) server_negotiation.cc:407] Connection header received
0810 21:05:06.313873 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:06.313874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:06.313893 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:06.313947 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:06.314301 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:06.314840 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:06.315607 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:06.315803 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:06.315881 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:06.318723 (+ 2842us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:46739: BlockingRecv error: recv got EOF from 127.15.37.3:46739 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 10 21:05:07 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:07 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:07.031479 29619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:07.023038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:44347)
0810 21:05:07.023248 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:07.023260 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:07.023327 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:07.023494 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:07.023495 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:07.023678 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:07.023735 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:07.023737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:07.024455 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:07.024457 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:07.025282 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:07.025286 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:07.025711 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:07.025712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:07.025763 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:07.029228 (+ 3465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:07.029234 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:07.031366 (+ 2132us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":146,"threads_started":1}
W20260810 21:05:07.031579 29620 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:07.023151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:44347 (local address 127.15.37.62:42197)
0810 21:05:07.023298 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:07.023300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:07.023311 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:05:07.023399 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:07.023400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:07.023412 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:07.023476 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:07.023801 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:07.024353 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:07.025372 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:07.025639 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:07.025694 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:07.031499 (+ 5805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:44347: BlockingRecv error: recv got EOF from 127.15.37.1:44347 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
Aug 10 21:05:07 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:07 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:07.175746 29621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:07.170548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:40189)
0810 21:05:07.170718 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:07.170733 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:07.170806 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:07.171017 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:07.171018 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:07.171215 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:07.171269 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:07.171271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:07.172005 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:07.172007 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:07.172580 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:07.172582 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:07.172964 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:07.172965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:07.173035 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:07.173587 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:07.173591 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:07.175677 (+ 2086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
W20260810 21:05:07.175894 29620 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:07.170667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:40189 (local address 127.15.37.62:42197)
0810 21:05:07.170756 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:07.170758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:07.170789 (+ 31us) server_negotiation.cc:407] Connection header received
0810 21:05:07.170907 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:07.170908 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:07.170924 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:07.171003 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:07.171372 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:07.171914 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:07.172675 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:07.172884 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:07.172965 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:07.175804 (+ 2839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:40189: BlockingRecv error: recv got EOF from 127.15.37.2:40189 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 10 21:05:07 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:07 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:07.324016 29622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:07.319390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:44983)
0810 21:05:07.319559 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:07.319578 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:07.319646 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:07.319786 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:07.319787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:07.319973 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:07.320031 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:07.320033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:07.320704 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:07.320705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:07.321235 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:07.321237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:07.321561 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:07.321562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:07.321601 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:07.322081 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:07.322085 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:07.323953 (+ 1868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":83,"threads_started":1}
W20260810 21:05:07.324174 29620 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:07.319504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:44983 (local address 127.15.37.62:42197)
0810 21:05:07.319565 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:07.319567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:07.319648 (+ 81us) server_negotiation.cc:407] Connection header received
0810 21:05:07.319704 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:07.319705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:07.319719 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:07.319763 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:07.320098 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:07.320637 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:07.321312 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:07.321496 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:07.321551 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:07.324080 (+ 2529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:44983: BlockingRecv error: recv got EOF from 127.15.37.3:44983 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 10 21:05:08 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:08 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:08.037423 29623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:08.032225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:46443)
0810 21:05:08.032400 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:08.032417 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:08.032505 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:08.032685 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:08.032686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:08.032874 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:08.032945 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:08.032946 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:08.033667 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:08.033668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:08.034238 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:08.034240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:08.034608 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:08.034609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:08.034652 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:08.035275 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:08.035280 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:08.037342 (+ 2062us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":121,"threads_started":1}
W20260810 21:05:08.037563 29624 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:08.032364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:46443 (local address 127.15.37.62:42197)
0810 21:05:08.032534 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:08.032536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:08.032546 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:05:08.032582 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:08.032583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:08.032595 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:08.032659 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:08.033030 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:08.033577 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:08.034323 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:08.034536 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:08.034591 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:08.037470 (+ 2879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:46443: BlockingRecv error: recv got EOF from 127.15.37.1:46443 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":88,"threads_started":1}
Aug 10 21:05:08 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:08 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:08.181059 29626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:08.176309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:51975)
0810 21:05:08.176519 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:08.176532 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:08.176598 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:08.176750 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:08.176751 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:08.176937 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:08.176993 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:08.176995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:08.177659 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:08.177660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:08.178190 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:08.178192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:08.178581 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:08.178582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:08.178624 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:08.179131 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:08.179136 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:08.180993 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":122,"threads_started":1}
W20260810 21:05:08.181216 29624 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:08.176526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:51975 (local address 127.15.37.62:42197)
0810 21:05:08.176622 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:08.176624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:08.176633 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:05:08.176659 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:08.176660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:08.176671 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:08.176730 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:08.177066 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:08.177586 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:08.178286 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:08.178504 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:08.178569 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:08.181120 (+ 2551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:51975: BlockingRecv error: recv got EOF from 127.15.37.2:51975 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 10 21:05:08 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:08 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:08.329787 29627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:08.324736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:43147)
0810 21:05:08.324960 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:08.324975 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:08.325065 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:08.325215 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:08.325216 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:08.325434 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:08.325485 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:08.325486 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:08.326201 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:08.326202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:08.326837 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:08.326839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:08.327249 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:08.327251 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:08.327312 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:08.327792 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:08.327796 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:08.329682 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":139,"threads_started":1}
W20260810 21:05:08.329849 29624 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:08.324885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:43147 (local address 127.15.37.62:42197)
0810 21:05:08.324964 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:08.324967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:08.325038 (+ 71us) server_negotiation.cc:407] Connection header received
0810 21:05:08.325134 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:08.325136 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:08.325154 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:08.325211 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:08.325573 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:08.326110 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:08.326922 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:08.327170 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:08.327249 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:08.329770 (+ 2521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:43147: BlockingRecv error: recv got EOF from 127.15.37.3:43147 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 10 21:05:09 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:09 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:09.045394 29629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:09.038082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:54323)
0810 21:05:09.038233 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:09.038252 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:09.038307 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:09.038513 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:09.038513 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:09.038696 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:09.038806 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:09.038808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:09.039927 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:09.039930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:09.040986 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:09.040992 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:09.041667 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:09.041668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:09.041765 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:09.042356 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:09.042362 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:09.045279 (+ 2917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":95,"threads_started":1}
W20260810 21:05:09.045503 29630 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:09.038184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:54323 (local address 127.15.37.62:42197)
0810 21:05:09.038341 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:09.038344 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:09.038354 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:05:09.038387 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:09.038388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:09.038401 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:09.038499 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:09.038977 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:09.039801 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:09.041141 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:09.041574 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:09.041655 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:09.045421 (+ 3766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:54323: BlockingRecv error: recv got EOF from 127.15.37.1:54323 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
Aug 10 21:05:09 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:09 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:09.187157 29631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:09.181700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:58029)
0810 21:05:09.181923 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:09.181936 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:09.182039 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:09.182213 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:09.182214 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:09.182415 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:09.182470 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:09.182472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:09.183225 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:09.183227 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:09.183769 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:09.183771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:09.184171 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:09.184173 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:09.184241 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:09.184942 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:09.184947 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:09.187095 (+ 2148us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":124,"threads_started":1}
W20260810 21:05:09.187317 29630 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:09.181833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:58029 (local address 127.15.37.62:42197)
0810 21:05:09.181924 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:09.181926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:09.182016 (+ 90us) server_negotiation.cc:407] Connection header received
0810 21:05:09.182124 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:09.182125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:09.182141 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:09.182192 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:09.182562 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:09.183128 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:09.183869 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:09.184081 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:09.184159 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:09.187221 (+ 3062us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:58029: BlockingRecv error: recv got EOF from 127.15.37.2:58029 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 10 21:05:09 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:09 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:09.335532 29633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:09.330346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:43197)
0810 21:05:09.330549 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:09.330562 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:09.330638 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:09.330794 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:09.330795 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:09.331007 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:09.331056 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:09.331058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:09.331757 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:09.331758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:09.332316 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:09.332318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:09.332771 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:09.332772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:09.332832 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:09.333335 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:09.333340 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:09.335416 (+ 2076us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":114,"threads_started":1}
W20260810 21:05:09.335593 29630 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:09.330470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:43197 (local address 127.15.37.62:42197)
0810 21:05:09.330552 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:09.330555 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:09.330621 (+ 66us) server_negotiation.cc:407] Connection header received
0810 21:05:09.330697 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:09.330698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:09.330713 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:09.330786 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:09.331158 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:09.331676 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:09.332411 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:09.332688 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:09.332757 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:09.335517 (+ 2760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:43197: BlockingRecv error: recv got EOF from 127.15.37.3:43197 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 10 21:05:10 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:10 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:10.051764 29634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:10.046162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:34893)
0810 21:05:10.046342 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:10.046352 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:10.046412 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:10.046625 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:10.046626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:10.046804 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:10.046860 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:10.046862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:10.047708 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:10.047709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:10.048389 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:10.048394 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:10.048841 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:10.048842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:10.048892 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:10.049496 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:10.049502 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:10.051696 (+ 2194us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":98,"threads_started":1}
W20260810 21:05:10.051884 29636 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:10.046262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:34893 (local address 127.15.37.62:42197)
0810 21:05:10.046433 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:10.046435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:10.046447 (+ 12us) server_negotiation.cc:407] Connection header received
0810 21:05:10.046485 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:10.046486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:10.046499 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:10.046571 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:10.046974 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:10.047608 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:10.048526 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:10.048763 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:10.048831 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:10.051802 (+ 2971us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:34893: BlockingRecv error: recv got EOF from 127.15.37.1:34893 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":100,"threads_started":1}
Aug 10 21:05:10 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:10 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:10.193650 29641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:10.187774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:43173)
0810 21:05:10.188009 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:10.188022 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:10.188101 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:10.188558 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:10.188560 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:10.188743 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:10.188800 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:10.188802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:10.189632 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:10.189633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:10.190302 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:10.190306 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:10.190722 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:10.190723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:10.190782 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:10.191370 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:10.191375 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:10.193567 (+ 2192us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":111,"threads_started":1}
W20260810 21:05:10.193823 29636 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:10.187832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:43173 (local address 127.15.37.62:42197)
0810 21:05:10.187908 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:10.187910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:10.188142 (+ 232us) server_negotiation.cc:407] Connection header received
0810 21:05:10.188206 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:10.188208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:10.188366 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:10.188545 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:10.188901 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:10.189445 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:10.190422 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:10.190639 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:10.190705 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:10.193720 (+ 3015us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:43173: BlockingRecv error: recv got EOF from 127.15.37.2:43173 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 10 21:05:10 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:10 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:10.341336 29642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:10.336159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:33049)
0810 21:05:10.336309 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:10.336323 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:10.336397 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:10.336600 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:10.336601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:10.336785 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:10.336850 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:10.336852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:10.337527 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:10.337527 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:10.338089 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:10.338091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:10.338496 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:10.338497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:10.338551 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:10.339110 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:10.339115 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:10.341271 (+ 2156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":76,"threads_started":1}
W20260810 21:05:10.341521 29636 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:10.336272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:33049 (local address 127.15.37.62:42197)
0810 21:05:10.336352 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:10.336354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:10.336379 (+ 25us) server_negotiation.cc:407] Connection header received
0810 21:05:10.336460 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:10.336461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:10.336496 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:10.336549 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:10.336925 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:10.337451 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:10.338193 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:10.338394 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:10.338473 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:10.341438 (+ 2965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:33049: BlockingRecv error: recv got EOF from 127.15.37.3:33049 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 10 21:05:11 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:11 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:11.057363 29643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:11.052303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:45683)
0810 21:05:11.052562 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:11.052574 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:11.052629 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:11.052762 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:11.052763 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:11.052939 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:11.052992 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:11.052993 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:11.053726 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:11.053727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:11.054265 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:11.054267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:11.054665 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:11.054666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:11.054707 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:11.055230 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:11.055235 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:11.057298 (+ 2063us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":122,"threads_started":1}
W20260810 21:05:11.057571 29645 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:11.052443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:45683 (local address 127.15.37.62:42197)
0810 21:05:11.052598 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:11.052601 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:11.052615 (+ 14us) server_negotiation.cc:407] Connection header received
0810 21:05:11.052688 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:11.052689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:11.052700 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:11.052759 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:11.053061 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:11.053653 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:11.054367 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:11.054589 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:11.054655 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:11.057401 (+ 2746us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:45683: BlockingRecv error: recv got EOF from 127.15.37.1:45683 (error 108)
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":106,"threads_started":1}
Aug 10 21:05:11 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:11 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:11.199832 29647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:11.194362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:53493)
0810 21:05:11.194553 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:11.194569 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:11.194654 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:11.194889 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:11.194891 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:11.195101 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:11.195154 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:11.195156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:11.196062 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:11.196063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:11.196702 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:11.196705 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:11.197082 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:11.197083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:11.197149 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:11.197696 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:11.197701 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:11.199767 (+ 2066us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":116,"threads_started":1}
W20260810 21:05:11.200016 29645 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:11.194403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:53493 (local address 127.15.37.62:42197)
0810 21:05:11.194467 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:11.194469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:11.194738 (+ 269us) server_negotiation.cc:407] Connection header received
0810 21:05:11.194772 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:11.194773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:11.194787 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:11.194877 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:11.195239 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:11.195974 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:11.196786 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:11.196995 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:11.197081 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:11.199938 (+ 2857us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:53493: BlockingRecv error: recv got EOF from 127.15.37.2:53493 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 10 21:05:11 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:11 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:11.346508 29648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:11.341885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:36021)
0810 21:05:11.342055 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:11.342068 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:11.342136 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:11.342295 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:11.342295 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:11.342480 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:11.342533 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:11.342534 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:11.343272 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:11.343273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:11.343793 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:11.343794 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:11.344131 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:11.344132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:11.344172 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:11.344661 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:11.344665 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:11.346445 (+ 1780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":93,"threads_started":1}
W20260810 21:05:11.346658 29645 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:11.341994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:36021 (local address 127.15.37.62:42197)
0810 21:05:11.342069 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:11.342070 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:11.342135 (+ 65us) server_negotiation.cc:407] Connection header received
0810 21:05:11.342206 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:11.342207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:11.342221 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:11.342266 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:11.342640 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:11.343197 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:11.343865 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:11.344067 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:11.344120 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:11.346572 (+ 2452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:36021: BlockingRecv error: recv got EOF from 127.15.37.3:36021 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 10 21:05:12 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:12 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:12.073321 29649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:12.058007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:33453)
0810 21:05:12.058215 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:12.058230 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:12.058315 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:12.058529 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:12.058530 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:12.058800 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:12.058871 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:12.058874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:12.059718 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:12.059719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:12.060280 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:12.060281 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:12.060770 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:12.060771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:12.060861 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:12.071104 (+ 10243us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:12.071112 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:12.073255 (+ 2143us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":101,"threads_started":1}
W20260810 21:05:12.073535 29650 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:12.058137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:33453 (local address 127.15.37.62:42197)
0810 21:05:12.058287 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:12.058289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:12.058300 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:05:12.058405 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:12.058406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:12.058422 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:12.058503 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:12.058981 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:12.059638 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:12.060388 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:12.060668 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:12.060736 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:12.073431 (+ 12695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:33453: BlockingRecv error: recv got EOF from 127.15.37.1:33453 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
Aug 10 21:05:12 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:12 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:12.205840 29653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:12.200468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:58649)
0810 21:05:12.200707 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:12.200721 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:12.200837 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:12.201034 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:12.201035 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:12.201236 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:12.201290 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:12.201292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:12.202210 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:12.202211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:12.202768 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:12.202770 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:12.203186 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:12.203187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:12.203259 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:12.203793 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:12.203797 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:12.205728 (+ 1931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":107,"threads_started":1}
W20260810 21:05:12.205904 29650 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:12.200588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:58649 (local address 127.15.37.62:42197)
0810 21:05:12.200695 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:12.200698 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:12.200806 (+ 108us) server_negotiation.cc:407] Connection header received
0810 21:05:12.200936 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:12.200947 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:12.200961 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:12.201024 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:12.201381 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:12.202119 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:12.202862 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:12.203103 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:12.203186 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:12.205837 (+ 2651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:58649: BlockingRecv error: recv got EOF from 127.15.37.2:58649 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 10 21:05:12 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:12 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:12.352337 29655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:12.347129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:56521)
0810 21:05:12.347305 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:12.347319 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:12.347412 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:12.347616 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:12.347618 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:12.347866 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:12.347939 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:12.347941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:12.348710 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:12.348711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:12.349250 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:12.349252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:12.349675 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:12.349676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:12.349738 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:12.350274 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:12.350279 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:12.352232 (+ 1953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":88,"threads_started":1}
W20260810 21:05:12.352393 29650 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:12.347240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:56521 (local address 127.15.37.62:42197)
0810 21:05:12.347309 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:12.347312 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:12.347482 (+ 170us) server_negotiation.cc:407] Connection header received
0810 21:05:12.347513 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:12.347514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:12.347530 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:12.347607 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:12.348024 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:12.348629 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:12.349340 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:12.349585 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:12.349672 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:12.352323 (+ 2651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:56521: BlockingRecv error: recv got EOF from 127.15.37.3:56521 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 10 21:05:13 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:13 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:13.078998 29659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:13.073919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:34301)
0810 21:05:13.074092 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:13.074108 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:13.074159 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:13.074369 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:13.074370 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:13.074551 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:13.074605 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:13.074606 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:13.075293 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:13.075294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:13.075986 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:13.075988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:13.076454 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:13.076455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:13.076551 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:13.077085 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:13.077091 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:13.078895 (+ 1804us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":122,"threads_started":1}
W20260810 21:05:13.079052 29660 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:13.074087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:34301 (local address 127.15.37.62:42197)
0810 21:05:13.074225 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:13.074227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:13.074236 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:05:13.074262 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:13.074263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:13.074278 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:13.074350 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:13.074672 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:13.075202 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:13.076096 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:13.076373 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:13.076452 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:13.078976 (+ 2524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:34301: BlockingRecv error: recv got EOF from 127.15.37.1:34301 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":77,"threads_started":1}
Aug 10 21:05:13 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:13 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:13.211951 29661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:13.206519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:59157)
0810 21:05:13.206698 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:13.206709 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:13.206772 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:13.206987 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:13.206988 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:13.207174 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:13.207232 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:13.207234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:13.207990 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:13.207992 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:13.208863 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:13.208867 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:13.209280 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:13.209282 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:13.209337 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:13.209859 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:13.209865 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:13.211846 (+ 1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":108,"threads_started":1}
W20260810 21:05:13.212016 29660 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:13.206657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:59157 (local address 127.15.37.62:42197)
0810 21:05:13.206731 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:13.206733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:13.206758 (+ 25us) server_negotiation.cc:407] Connection header received
0810 21:05:13.206837 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:13.206838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:13.206850 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:13.206955 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:13.207350 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:13.207886 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:13.208953 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:13.209190 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:13.209254 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:13.211946 (+ 2692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:59157: BlockingRecv error: recv got EOF from 127.15.37.2:59157 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 10 21:05:13 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:13 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:13.357663 29662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:13.353012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:47909)
0810 21:05:13.353171 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:13.353182 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:13.353273 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:13.353448 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:13.353449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:13.353615 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:13.353667 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:13.353668 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:13.354312 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:13.354313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:13.354852 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:13.354853 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:13.355175 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:13.355176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:13.355218 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:13.355694 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:13.355700 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:13.357556 (+ 1856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":102,"threads_started":1}
W20260810 21:05:13.357717 29660 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:13.353129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:47909 (local address 127.15.37.62:42197)
0810 21:05:13.353175 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:13.353177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:13.353279 (+ 102us) server_negotiation.cc:407] Connection header received
0810 21:05:13.353342 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:13.353343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:13.353360 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:13.353414 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:13.353734 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:13.354243 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:13.354926 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:13.355112 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:13.355163 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:13.357666 (+ 2503us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:47909: BlockingRecv error: recv got EOF from 127.15.37.3:47909 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 10 21:05:14 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:14 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:14.084895 29664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:14.079638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:39773)
0810 21:05:14.079866 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:14.079884 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:14.079962 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:14.080117 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:14.080118 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:14.080311 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:14.080370 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:14.080372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:14.081110 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:14.081111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:14.081670 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:14.081672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:14.082023 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:14.082024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:14.082069 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:14.082591 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:14.082596 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:14.084832 (+ 2236us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":109,"threads_started":1}
W20260810 21:05:14.085067 29665 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:14.079781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:39773 (local address 127.15.37.62:42197)
0810 21:05:14.079926 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:14.079929 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:14.079945 (+ 16us) server_negotiation.cc:407] Connection header received
0810 21:05:14.080019 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:14.080020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:14.080033 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:14.080094 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:14.080459 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:14.081019 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:14.081750 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:14.081955 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:14.082006 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:14.084957 (+ 2951us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:39773: BlockingRecv error: recv got EOF from 127.15.37.1:39773 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
Aug 10 21:05:14 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:14 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:14.217964 29666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:14.212661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:46871)
0810 21:05:14.212871 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:14.212889 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:14.212972 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:14.213191 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:14.213192 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:14.213372 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:14.213425 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:14.213427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:14.214287 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:14.214288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:14.214870 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:14.214871 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:14.215302 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:14.215303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:14.215357 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:14.215926 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:14.215931 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:14.217865 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":100,"threads_started":1}
W20260810 21:05:14.218024 29665 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:14.212754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:46871 (local address 127.15.37.62:42197)
0810 21:05:14.212852 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:14.212854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:14.213007 (+ 153us) server_negotiation.cc:407] Connection header received
0810 21:05:14.213051 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:14.213052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:14.213067 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:14.213136 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:14.213514 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:14.214191 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:14.214956 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:14.215229 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:14.215283 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:14.217966 (+ 2683us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:46871: BlockingRecv error: recv got EOF from 127.15.37.2:46871 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 10 21:05:14 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:14 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:14.363443 29667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:14.358254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:40819)
0810 21:05:14.358419 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:14.358430 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:14.358503 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:14.358650 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:14.358651 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:14.358947 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:14.359000 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:14.359002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:14.359689 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:14.359691 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:14.360445 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:14.360450 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:14.360904 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:14.360905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:14.360953 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:14.361435 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:14.361439 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:14.363358 (+ 1919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":108,"threads_started":1}
W20260810 21:05:14.363564 29665 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:14.358313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:40819 (local address 127.15.37.62:42197)
0810 21:05:14.358394 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:14.358396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:14.358499 (+ 103us) server_negotiation.cc:407] Connection header received
0810 21:05:14.358583 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:14.358584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:14.358599 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:14.358645 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:14.359069 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:14.359588 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:14.360562 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:14.360817 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:14.360900 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:14.363457 (+ 2557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:40819: BlockingRecv error: recv got EOF from 127.15.37.3:40819 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 10 21:05:15 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:15 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:15.090519 29669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:15.085369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:44747)
0810 21:05:15.085524 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:15.085537 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:15.085600 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:15.085749 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:15.085750 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:15.085937 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:15.086004 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:15.086006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:15.086875 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:15.086876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:15.087458 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:15.087460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:15.087886 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:15.087887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:15.087954 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:15.088557 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:15.088567 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:15.090444 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":66,"threads_started":1}
W20260810 21:05:15.090770 29670 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:15.085441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:44747 (local address 127.15.37.62:42197)
0810 21:05:15.085612 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:15.085614 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:15.085624 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:05:15.085650 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:15.085650 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:15.085663 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:15.085733 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:15.086075 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:15.086772 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:15.087553 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:15.087776 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:15.087837 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:15.090678 (+ 2841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:44747: BlockingRecv error: recv got EOF from 127.15.37.1:44747 (error 108)
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":76,"threads_started":1}
Aug 10 21:05:15 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:15 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:15.223228 29673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:15.218531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:49405)
0810 21:05:15.218672 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:15.218687 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:15.218746 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:15.218884 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:15.218885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:15.219072 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:15.219122 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:15.219123 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:15.219808 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:15.219810 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:15.220395 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:15.220397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:15.220760 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:15.220761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:15.220804 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:15.221280 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:15.221285 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:15.223155 (+ 1870us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":86,"threads_started":1}
W20260810 21:05:15.223384 29670 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:15.218594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:49405 (local address 127.15.37.62:42197)
0810 21:05:15.218661 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:15.218664 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:15.218745 (+ 81us) server_negotiation.cc:407] Connection header received
0810 21:05:15.218811 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:15.218812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:15.218825 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:15.218868 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:15.219183 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:15.219720 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:15.220496 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:15.220694 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:15.220751 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:15.223282 (+ 2531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:49405: BlockingRecv error: recv got EOF from 127.15.37.2:49405 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 10 21:05:15 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:15 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:15.369326 29674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:15.364035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:58827)
0810 21:05:15.364245 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:15.364261 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:15.364353 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:15.364552 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:15.364553 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:15.364760 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:15.364809 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:15.364811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:15.365571 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:15.365572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:15.366142 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:15.366144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:15.366516 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:15.366517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:15.366577 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:15.367199 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:15.367205 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:15.369236 (+ 2031us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":107,"threads_started":1}
W20260810 21:05:15.369414 29670 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:15.364160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:58827 (local address 127.15.37.62:42197)
0810 21:05:15.364265 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:15.364268 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:15.364328 (+ 60us) server_negotiation.cc:407] Connection header received
0810 21:05:15.364414 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:15.364415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:15.364431 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:15.364537 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:15.364930 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:15.365470 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:15.366233 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:15.366440 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:15.366518 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:15.369349 (+ 2831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:58827: BlockingRecv error: recv got EOF from 127.15.37.3:58827 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 10 21:05:16 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:16 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:16.096104 29675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:16.091128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:57539)
0810 21:05:16.091319 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:16.091330 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:16.091391 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:16.091543 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:16.091543 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:16.091725 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:16.091777 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:16.091779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:16.092461 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:16.092462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:16.093069 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:16.093071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:16.093462 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:16.093463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:16.093506 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:16.094038 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:16.094042 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:16.096030 (+ 1988us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":127,"threads_started":1}
W20260810 21:05:16.096225 29677 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:16.091230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:57539 (local address 127.15.37.62:42197)
0810 21:05:16.091364 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:16.091366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:16.091378 (+ 12us) server_negotiation.cc:407] Connection header received
0810 21:05:16.091458 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:16.091459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:16.091472 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:16.091531 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:16.091849 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:16.092393 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:16.093165 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:16.093377 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:16.093453 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:16.096124 (+ 2671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:57539: BlockingRecv error: recv got EOF from 127.15.37.1:57539 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":63,"threads_started":1}
Aug 10 21:05:16 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:16 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:16.229707 29681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:16.224019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:55107)
0810 21:05:16.224217 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:16.224233 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:16.224318 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:16.224555 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:16.224556 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:16.224819 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:16.224894 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:16.224897 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:16.225745 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:16.225746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:16.226636 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:16.226641 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:16.227056 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:16.227057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:16.227107 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:16.227579 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:16.227584 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:16.229629 (+ 2045us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":98,"threads_started":1}
W20260810 21:05:16.229844 29677 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:16.224228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:55107 (local address 127.15.37.62:42197)
0810 21:05:16.224298 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:16.224300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:16.224314 (+ 14us) server_negotiation.cc:407] Connection header received
0810 21:05:16.224417 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:16.224419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:16.224436 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:16.224526 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:16.225067 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:16.225635 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:16.226743 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:16.226980 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:16.227040 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:16.229756 (+ 2716us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:55107: BlockingRecv error: recv got EOF from 127.15.37.2:55107 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 10 21:05:16 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:16 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:16.375267 29682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:16.370002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:59071)
0810 21:05:16.370207 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:16.370223 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:16.370313 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:16.370490 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:16.370491 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:16.370752 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:16.370811 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:16.370822 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:16.371540 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:16.371542 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:16.372104 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:16.372106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:16.372544 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:16.372545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:16.372744 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:16.373296 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:16.373301 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:16.375192 (+ 1891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":124,"threads_started":1}
W20260810 21:05:16.375375 29677 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:16.370124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:59071 (local address 127.15.37.62:42197)
0810 21:05:16.370195 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:16.370198 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:16.370328 (+ 130us) server_negotiation.cc:407] Connection header received
0810 21:05:16.370375 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:16.370376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:16.370396 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:16.370464 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:16.370897 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:16.371439 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:16.372196 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:16.372410 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:16.372468 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:16.375302 (+ 2834us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:59071: BlockingRecv error: recv got EOF from 127.15.37.3:59071 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 10 21:05:17 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:17 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:17.104576 29684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:17.096695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:48517)
0810 21:05:17.096829 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:17.096845 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:17.096898 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:17.097064 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:17.097065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:17.097255 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:17.097309 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:17.097311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:17.098005 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:17.098006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:17.098571 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:17.098573 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:17.098898 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:17.098899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:17.098942 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:17.102559 (+ 3617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:17.102565 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:17.104511 (+ 1946us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":74,"threads_started":1}
W20260810 21:05:17.104758 29685 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:17.096735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:48517 (local address 127.15.37.62:42197)
0810 21:05:17.096867 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:17.096869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:17.096880 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:05:17.096957 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:17.096958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:17.096970 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:17.097033 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:17.097391 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:17.097922 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:17.098641 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:17.098834 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:17.098884 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:17.104657 (+ 5773us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:48517: BlockingRecv error: recv got EOF from 127.15.37.1:48517 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":73,"threads_started":1}
Aug 10 21:05:17 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:17 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:17.235356 29686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:17.230273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:41825)
0810 21:05:17.230493 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:17.230509 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:17.230610 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:17.230783 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:17.230784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:17.231013 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:17.231066 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:17.231068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:17.231803 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:17.231804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:17.232354 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:17.232355 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:17.232793 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:17.232795 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:17.232856 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:17.233390 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:17.233395 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:17.235260 (+ 1865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":122,"threads_started":1}
W20260810 21:05:17.235435 29685 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:17.230404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:41825 (local address 127.15.37.62:42197)
0810 21:05:17.230509 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:17.230512 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:17.230589 (+ 77us) server_negotiation.cc:407] Connection header received
0810 21:05:17.230706 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:17.230707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:17.230721 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:17.230765 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:17.231165 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:17.231702 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:17.232457 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:17.232713 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:17.232795 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:17.235368 (+ 2573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:41825: BlockingRecv error: recv got EOF from 127.15.37.2:41825 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 10 21:05:17 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:17 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.3@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:17.381699 29687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:17.375856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.3:53401)
0810 21:05:17.376015 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:17.376028 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:17.376111 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:17.376259 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:17.376259 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:17.376447 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:17.376564 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:17.376565 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:17.377275 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:17.377276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:17.377910 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:17.377913 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:17.378347 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:17.378348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:17.378438 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:17.378991 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:17.378996 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:17.381611 (+ 2615us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
W20260810 21:05:17.381914 29685 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:17.375963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:53401 (local address 127.15.37.62:42197)
0810 21:05:17.376075 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:17.376077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:17.376094 (+ 17us) server_negotiation.cc:407] Connection header received
0810 21:05:17.376166 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:17.376167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:17.376184 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:17.376237 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:17.376649 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:17.377173 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:17.378030 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:17.378254 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:17.378323 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:17.381752 (+ 3429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.3:53401: BlockingRecv error: recv got EOF from 127.15.37.3:53401 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 10 21:05:18 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:18 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.1@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:18.109977 29688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:18.105182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.1:57389)
0810 21:05:18.105364 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:18.105376 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:18.105429 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:18.105607 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:18.105609 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:18.105791 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:18.105856 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:18.105858 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.106584 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.106585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:18.107157 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:18.107159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.107517 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.107517 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:18.107561 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:18.108034 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:18.108039 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:18.109908 (+ 1869us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":110,"threads_started":1}
W20260810 21:05:18.110124 29689 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:18.105297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:57389 (local address 127.15.37.62:42197)
0810 21:05:18.105426 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:18.105428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:18.105448 (+ 20us) server_negotiation.cc:407] Connection header received
0810 21:05:18.105474 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:18.105475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:18.105487 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:18.105554 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:18.105942 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.106499 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.107233 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.107447 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.107506 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:18.110028 (+ 2522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.1:57389: BlockingRecv error: recv got EOF from 127.15.37.1:57389 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":78,"threads_started":1}
Aug 10 21:05:18 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
Aug 10 21:05:18 dist-test-slave-jq4t krb5kdc[28018](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.15.37.2@KRBTEST.COM for oryx/127.15.37.62@KRBTEST.COM, Server not found in Kerberos database
I20260810 21:05:18.240624 29691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:18.235980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42197 (local address 127.15.37.2:44097)
0810 21:05:18.236115 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:18.236132 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:18.236188 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:18.236326 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:18.236327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:18.236539 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:18.236594 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:18.236595 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.237296 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.237296 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:18.237830 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:18.237832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.238188 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.238188 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:18.238233 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:18.238715 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:18.238720 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:18.240526 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.15.37.62:42197: Server oryx/127.15.37.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
W20260810 21:05:18.240645 29689 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:18.236044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:44097 (local address 127.15.37.62:42197)
0810 21:05:18.236133 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:18.236135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:18.236188 (+ 53us) server_negotiation.cc:407] Connection header received
0810 21:05:18.236239 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:18.236240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:18.236253 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:18.236319 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:18.236694 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.237218 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.237921 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.238122 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.238180 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:18.240596 (+ 2416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.15.37.2:44097: BlockingRecv error: recv got EOF from 127.15.37.2:44097 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 21:05:18.289415 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 28952
I20260810 21:05:18.303272 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 29191
I20260810 21:05:18.318717 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 29378
I20260810 21:05:18.329936 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 28839
2026-08-10T21:05:18Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17918 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-10T21:05:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:05:18Z Disabled control of system clock
I20260810 21:05:18.366858 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:36565
--webserver_interface=127.15.37.62
--webserver_port=0
--builtin_ntp_servers=127.15.37.20:39189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:36565
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 21:05:18.453841 29699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:18.454077 29699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:18.454098 29699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:18.455343 29699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:05:18.455391 29699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:18.455404 29699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:18.455417 29699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:05:18.455430 29699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:05:18.456902 29699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:39189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:36565
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:36565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:18.457208 29699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:18.457549 29699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:18.463152 29710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:18.463145 29714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:18.463183 29699 server_base.cc:1034] running on GCE node
W20260810 21:05:18.463145 29711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:18.463680 29699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:18.464013 29699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:18.465198 29699 hybrid_clock.cc:648] HybridClock initialized: now 1786395918465179 us; error 33 us; skew 500 ppm
I20260810 21:05:18.466574 29699 webserver.cc:460] Webserver started at http://127.15.37.62:33169/ using document root <none> and password file <none>
I20260810 21:05:18.466847 29699 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:18.466923 29699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:18.467074 29699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:18.468192 29699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "705bc508b7d94f4d97d1518d5766797a"
format_stamp: "Formatted at 2026-08-10 21:05:18 on dist-test-slave-jq4t"
server_key: "52ff6d7915689074857ef52629716498"
server_key_iv: "e62fdb2ce073f8ba4d2eb8bfb90b11a5"
server_key_version: "encryptionkey@0"
I20260810 21:05:18.468632 29699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "705bc508b7d94f4d97d1518d5766797a"
format_stamp: "Formatted at 2026-08-10 21:05:18 on dist-test-slave-jq4t"
server_key: "52ff6d7915689074857ef52629716498"
server_key_iv: "e62fdb2ce073f8ba4d2eb8bfb90b11a5"
server_key_version: "encryptionkey@0"
I20260810 21:05:18.470046 29699 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:05:18.470916 29721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:18.471143 29699 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:05:18.471249 29699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "705bc508b7d94f4d97d1518d5766797a"
format_stamp: "Formatted at 2026-08-10 21:05:18 on dist-test-slave-jq4t"
server_key: "52ff6d7915689074857ef52629716498"
server_key_iv: "e62fdb2ce073f8ba4d2eb8bfb90b11a5"
server_key_version: "encryptionkey@0"
I20260810 21:05:18.471335 29699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:18.484179 29699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:18.484622 29699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:18.484786 29699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:18.489269 29699 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:36565
I20260810 21:05:18.489315 29804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:36565 every 8 connection(s)
I20260810 21:05:18.489718 29699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:05:18.490440 29805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:05:18.491981 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 29699
I20260810 21:05:18.492089 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:05:18.492308 15508 external_mini_cluster.cc:1428] Setting key 78d547533f42ba5eaf54df0c035b4eb2
I20260810 21:05:18.493768 29805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a: Bootstrap starting.
I20260810 21:05:18.494436 29805 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a: Neither blocks nor log segments found. Creating new log.
I20260810 21:05:18.494817 29805 log.cc:824] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a: Log is configured to *not* fsync() on all Append() calls
I20260810 21:05:18.495558 29805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a: No bootstrap required, opened a new log
I20260810 21:05:18.497697 29805 raft_consensus.cc:348] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "705bc508b7d94f4d97d1518d5766797a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36565 } }
I20260810 21:05:18.497876 29805 raft_consensus.cc:374] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:05:18.497956 29805 raft_consensus.cc:729] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 705bc508b7d94f4d97d1518d5766797a, State: Initialized, Role: FOLLOWER
I20260810 21:05:18.498136 29805 consensus_queue.cc:260] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "705bc508b7d94f4d97d1518d5766797a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36565 } }
I20260810 21:05:18.498251 29805 raft_consensus.cc:388] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:05:18.498337 29805 raft_consensus.cc:482] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:05:18.498392 29805 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:05:18.498422 29809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:18.492935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60334 (local address 127.15.37.62:36565)
0810 21:05:18.493198 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:18.493206 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:18.493232 (+ 26us) server_negotiation.cc:407] Connection header received
0810 21:05:18.493660 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:18.493667 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:18.493729 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:18.493882 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:18.494120 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.495204 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.496076 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.496594 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.496748 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:18.497597 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:18.497607 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:18.497607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:05:18.497815 (+ 208us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:18.497852 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:05:18.497864 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:18.497967 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:18.498048 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 21:05:18.498143 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":87,"threads_started":1}
I20260810 21:05:18.499161 29805 raft_consensus.cc:504] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "705bc508b7d94f4d97d1518d5766797a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36565 } }
I20260810 21:05:18.499296 29805 leader_election.cc:302] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 705bc508b7d94f4d97d1518d5766797a; no voters:
I20260810 21:05:18.499476 29805 leader_election.cc:288] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:05:18.499536 29817 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:05:18.499722 29817 raft_consensus.cc:686] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [term 1 LEADER]: Becoming Leader. State: Replica: 705bc508b7d94f4d97d1518d5766797a, State: Running, Role: LEADER
I20260810 21:05:18.499794 29805 sys_catalog.cc:564] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:05:18.499816 29817 consensus_queue.cc:237] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "705bc508b7d94f4d97d1518d5766797a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36565 } }
I20260810 21:05:18.500211 29819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "705bc508b7d94f4d97d1518d5766797a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "705bc508b7d94f4d97d1518d5766797a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36565 } } }
I20260810 21:05:18.500387 29819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [sys.catalog]: This master's current role is: LEADER
I20260810 21:05:18.500221 29821 sys_catalog.cc:455] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 705bc508b7d94f4d97d1518d5766797a. Latest consensus state: current_term: 1 leader_uuid: "705bc508b7d94f4d97d1518d5766797a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "705bc508b7d94f4d97d1518d5766797a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36565 } } }
I20260810 21:05:18.500554 29821 sys_catalog.cc:458] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a [sys.catalog]: This master's current role is: LEADER
I20260810 21:05:18.500813 29830 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:05:18.501332 29830 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:05:18.502879 29830 catalog_manager.cc:1347] Generated new cluster ID: cc3dd901ad7d4f98b48033f2145b99c5
I20260810 21:05:18.502938 29830 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:05:18.510596 29830 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:05:18.511415 29830 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:05:18.526548 29830 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 705bc508b7d94f4d97d1518d5766797a: Generated new TSK 0
I20260810 21:05:18.526805 29830 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:05:18.535004 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36565
--builtin_ntp_servers=127.15.37.20:39189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 21:05:18.626364 29845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:18.626577 29845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:18.626600 29845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:18.627804 29845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:18.627849 29845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:18.627876 29845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:05:18.629343 29845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:39189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:18.629621 29845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:18.629943 29845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:18.635790 29853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:18.635800 29854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:18.635808 29856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:18.636371 29845 server_base.cc:1034] running on GCE node
I20260810 21:05:18.636627 29845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:18.636874 29845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:18.638046 29845 hybrid_clock.cc:648] HybridClock initialized: now 1786395918638026 us; error 39 us; skew 500 ppm
I20260810 21:05:18.639433 29845 webserver.cc:460] Webserver started at http://127.15.37.1:45581/ using document root <none> and password file <none>
I20260810 21:05:18.639722 29845 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:18.639772 29845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:18.639952 29845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:18.641165 29845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "a99e24b79a764f1a890858fe42cfd435"
format_stamp: "Formatted at 2026-08-10 21:05:18 on dist-test-slave-jq4t"
server_key: "1eaa6a1e35d94934934e5d139e00919a"
server_key_iv: "6ee8d0f046a81bfe71d75af34a78b384"
server_key_version: "encryptionkey@0"
I20260810 21:05:18.641541 29845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "a99e24b79a764f1a890858fe42cfd435"
format_stamp: "Formatted at 2026-08-10 21:05:18 on dist-test-slave-jq4t"
server_key: "1eaa6a1e35d94934934e5d139e00919a"
server_key_iv: "6ee8d0f046a81bfe71d75af34a78b384"
server_key_version: "encryptionkey@0"
I20260810 21:05:18.642896 29845 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 21:05:18.643678 29862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:18.643853 29845 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 21:05:18.643950 29845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "a99e24b79a764f1a890858fe42cfd435"
format_stamp: "Formatted at 2026-08-10 21:05:18 on dist-test-slave-jq4t"
server_key: "1eaa6a1e35d94934934e5d139e00919a"
server_key_iv: "6ee8d0f046a81bfe71d75af34a78b384"
server_key_version: "encryptionkey@0"
I20260810 21:05:18.644021 29845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:18.658721 29845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:18.659101 29845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:18.659263 29845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:18.659509 29845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:18.659884 29845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:18.659938 29845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:18.659973 29845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:18.660002 29845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:18.666285 29845 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:40873
I20260810 21:05:18.666332 30053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:40873 every 8 connection(s)
I20260810 21:05:18.666692 29845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:05:18.671691 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 29845
I20260810 21:05:18.671798 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:05:18.672056 15508 external_mini_cluster.cc:1428] Setting key 348040341ff3631eb9647739b42abbb0
I20260810 21:05:18.672439 29809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:18.667455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:46313 (local address 127.15.37.62:36565)
0810 21:05:18.667519 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:18.667521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:18.667747 (+ 226us) server_negotiation.cc:407] Connection header received
0810 21:05:18.668340 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:18.668342 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:18.668355 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:18.668410 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:18.669175 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.669710 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.670758 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.670979 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.671055 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:18.672082 (+ 1027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:18.672083 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:18.672084 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:05:18.672089 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:18.672109 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:05:18.672113 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:18.672170 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:18.672312 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 21:05:18.672352 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 21:05:18.672796 30060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:18.667406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36565 (local address 127.15.37.1:46313)
0810 21:05:18.667621 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:18.667658 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:18.668220 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:18.668520 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:18.668524 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:18.668535 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:18.669056 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:18.669062 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.669807 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.669808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:18.670660 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:18.670663 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.671066 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.671067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:18.671207 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:18.671916 (+ 709us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:05:18.671917 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:18.671961 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:05:18.671985 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:05:18.672211 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:05:18.672220 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:05:18.672223 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:05:18.672307 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 21:05:18.672399 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":84,"threads_started":1}
I20260810 21:05:18.673163 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36565
--builtin_ntp_servers=127.15.37.20:39189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 21:05:18.673440 30058 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36565
I20260810 21:05:18.673543 30058 heartbeater.cc:464] Registering TS with master...
I20260810 21:05:18.673735 30058 heartbeater.cc:511] Master 127.15.37.62:36565 requested a full tablet report, sending...
I20260810 21:05:18.674247 29748 ts_manager.cc:194] Registered new tserver with Master: a99e24b79a764f1a890858fe42cfd435 (127.15.37.1:40873)
I20260810 21:05:18.674958 29748 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.37.1:46313
W20260810 21:05:18.759306 30061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:18.759557 30061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:18.759595 30061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:18.760914 30061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:18.760974 30061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:18.761019 30061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:05:18.762473 30061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:39189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:18.762933 30061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:18.763290 30061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:18.768674 30074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:18.768853 30061 server_base.cc:1034] running on GCE node
W20260810 21:05:18.768708 30076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:18.768684 30079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:18.769200 30061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:18.769413 30061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:18.770562 30061 hybrid_clock.cc:648] HybridClock initialized: now 1786395918770549 us; error 30 us; skew 500 ppm
I20260810 21:05:18.771970 30061 webserver.cc:460] Webserver started at http://127.15.37.2:36429/ using document root <none> and password file <none>
I20260810 21:05:18.772221 30061 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:18.772271 30061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:18.772455 30061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:18.773648 30061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "de2bd73e199d4f038f8a09f3bc8ea8b0"
format_stamp: "Formatted at 2026-08-10 21:05:18 on dist-test-slave-jq4t"
server_key: "997f856b955d4884f9095502087cefaf"
server_key_iv: "e9cf9a93cb80e3aff3d987cbff063fda"
server_key_version: "encryptionkey@0"
I20260810 21:05:18.774013 30061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "de2bd73e199d4f038f8a09f3bc8ea8b0"
format_stamp: "Formatted at 2026-08-10 21:05:18 on dist-test-slave-jq4t"
server_key: "997f856b955d4884f9095502087cefaf"
server_key_iv: "e9cf9a93cb80e3aff3d987cbff063fda"
server_key_version: "encryptionkey@0"
I20260810 21:05:18.775447 30061 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:05:18.776247 30091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:18.776441 30061 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:05:18.776585 30061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "de2bd73e199d4f038f8a09f3bc8ea8b0"
format_stamp: "Formatted at 2026-08-10 21:05:18 on dist-test-slave-jq4t"
server_key: "997f856b955d4884f9095502087cefaf"
server_key_iv: "e9cf9a93cb80e3aff3d987cbff063fda"
server_key_version: "encryptionkey@0"
I20260810 21:05:18.776665 30061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:18.790513 30061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:18.790874 30061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:18.791010 30061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:18.791282 30061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:18.791652 30061 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:18.791706 30061 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:18.791750 30061 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:18.791779 30061 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:18.797813 30061 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:41021
I20260810 21:05:18.797860 30266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:41021 every 8 connection(s)
I20260810 21:05:18.798220 30061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:05:18.799495 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 30061
I20260810 21:05:18.799614 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:05:18.799845 15508 external_mini_cluster.cc:1428] Setting key b355af41bf7762aed3237f282256c585
I20260810 21:05:18.801064 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36565
--builtin_ntp_servers=127.15.37.20:39189
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 21:05:18.804616 29809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:18.799035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:46893 (local address 127.15.37.62:36565)
0810 21:05:18.799113 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:18.799115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:18.799382 (+ 267us) server_negotiation.cc:407] Connection header received
0810 21:05:18.800138 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:18.800139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:18.800154 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:18.800199 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:18.801151 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.801760 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.803017 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.803216 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.803279 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:18.804308 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:18.804310 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:18.804310 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:05:18.804315 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:18.804330 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:05:18.804333 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:18.804379 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:18.804514 (+ 135us) server_negotiation.cc:299] Negotiation successful
0810 21:05:18.804543 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 21:05:18.804965 30269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:18.799016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36565 (local address 127.15.37.2:46893)
0810 21:05:18.799254 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:18.799290 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:18.799996 (+ 706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:18.800294 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:18.800299 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:18.800313 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:18.801056 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:18.801062 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.801856 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.801857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:18.802916 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:18.802920 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.803311 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.803313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:18.803487 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:18.804138 (+ 651us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:05:18.804139 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:18.804180 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:05:18.804212 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:05:18.804396 (+ 184us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:05:18.804402 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:05:18.804406 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:05:18.804500 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 21:05:18.804625 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":120,"threads_started":1}
I20260810 21:05:18.805483 30267 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36565
I20260810 21:05:18.805603 30267 heartbeater.cc:464] Registering TS with master...
I20260810 21:05:18.805804 30267 heartbeater.cc:511] Master 127.15.37.62:36565 requested a full tablet report, sending...
I20260810 21:05:18.806262 29748 ts_manager.cc:194] Registered new tserver with Master: de2bd73e199d4f038f8a09f3bc8ea8b0 (127.15.37.2:41021)
I20260810 21:05:18.806651 29748 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.37.2:46893
W20260810 21:05:18.889704 30270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:18.889976 30270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:18.890017 30270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:18.891219 30270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:18.891291 30270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:18.891331 30270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:05:18.892781 30270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:39189
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:18.893087 30270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:18.893446 30270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:18.898950 30276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:18.898957 30279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:18.898950 30284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:18.899164 30270 server_base.cc:1034] running on GCE node
I20260810 21:05:18.899492 30270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:18.899777 30270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:18.901036 30270 hybrid_clock.cc:648] HybridClock initialized: now 1786395918901017 us; error 31 us; skew 500 ppm
I20260810 21:05:18.902449 30270 webserver.cc:460] Webserver started at http://127.15.37.3:42621/ using document root <none> and password file <none>
I20260810 21:05:18.902663 30270 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:18.902705 30270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:18.902806 30270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:18.903971 30270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "ceaf69e97346426fa9d728ca12bbbaac"
format_stamp: "Formatted at 2026-08-10 21:05:18 on dist-test-slave-jq4t"
server_key: "f7a4a79d84d5353788974a10642488e0"
server_key_iv: "93cca4cbe00794286e607e02d098db44"
server_key_version: "encryptionkey@0"
I20260810 21:05:18.904307 30270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "ceaf69e97346426fa9d728ca12bbbaac"
format_stamp: "Formatted at 2026-08-10 21:05:18 on dist-test-slave-jq4t"
server_key: "f7a4a79d84d5353788974a10642488e0"
server_key_iv: "93cca4cbe00794286e607e02d098db44"
server_key_version: "encryptionkey@0"
I20260810 21:05:18.905762 30270 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:05:18.906576 30297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:18.906766 30270 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:05:18.906875 30270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "ceaf69e97346426fa9d728ca12bbbaac"
format_stamp: "Formatted at 2026-08-10 21:05:18 on dist-test-slave-jq4t"
server_key: "f7a4a79d84d5353788974a10642488e0"
server_key_iv: "93cca4cbe00794286e607e02d098db44"
server_key_version: "encryptionkey@0"
I20260810 21:05:18.906967 30270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:18.918152 30270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:18.918500 30270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:18.918654 30270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:18.918888 30270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:18.919268 30270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:18.919323 30270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:18.919360 30270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:18.919401 30270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:18.925596 30270 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:41245
I20260810 21:05:18.925637 30484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:41245 every 8 connection(s)
I20260810 21:05:18.926002 30270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:05:18.927886 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 30270
I20260810 21:05:18.928000 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:05:18.928234 15508 external_mini_cluster.cc:1428] Setting key dd8e8db7aeff1f1da2bd603a4e0ea2ca
I20260810 21:05:18.931875 29809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:18.926826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:45857 (local address 127.15.37.62:36565)
0810 21:05:18.926919 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:18.926922 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:18.927148 (+ 226us) server_negotiation.cc:407] Connection header received
0810 21:05:18.927632 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:18.927633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:18.927646 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:18.927709 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:18.928760 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.929442 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.930423 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.930617 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.930669 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:18.931586 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:18.931588 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:18.931588 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:05:18.931593 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:18.931613 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:05:18.931617 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:18.931671 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:18.931748 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 21:05:18.931772 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 21:05:18.932051 30489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:18.926783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36565 (local address 127.15.37.3:45857)
0810 21:05:18.927006 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:18.927042 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:18.927547 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:18.927788 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:18.927793 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:18.927804 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:18.928633 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:18.928642 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.929522 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.929522 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:18.930350 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:18.930352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:18.930691 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:18.930692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:18.930803 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:18.931441 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:05:18.931442 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:18.931471 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:05:18.931495 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:05:18.931680 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:05:18.931684 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:05:18.931686 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 21:05:18.931739 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 21:05:18.931825 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":103,"threads_started":1}
I20260810 21:05:18.932471 30485 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36565
I20260810 21:05:18.932590 30485 heartbeater.cc:464] Registering TS with master...
I20260810 21:05:18.932753 30485 heartbeater.cc:511] Master 127.15.37.62:36565 requested a full tablet report, sending...
I20260810 21:05:18.933107 29748 ts_manager.cc:194] Registered new tserver with Master: ceaf69e97346426fa9d728ca12bbbaac (127.15.37.3:41245)
I20260810 21:05:18.933460 29748 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.37.3:45857
I20260810 21:05:18.940434 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 21:05:18.942512 29809 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:18.941966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60344 (local address 127.15.37.62:36565)
0810 21:05:18.942017 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:18.942020 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:18.942170 (+ 150us) server_negotiation.cc:407] Connection header received
0810 21:05:18.942214 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:18.942215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:18.942225 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:18.942281 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:18.942423 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60344: BlockingRecv error: recv got EOF from 127.0.0.1:60344 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 21:05:18.942626 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 29845
I20260810 21:05:18.972100 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 30061
I20260810 21:05:18.990924 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 30270
I20260810 21:05:19.001665 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 29699
2026-08-10T21:05:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (670 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-10T21:05:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:05:19Z Disabled control of system clock
I20260810 21:05:19.038749 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:36425
--webserver_interface=127.15.37.62
--webserver_port=0
--builtin_ntp_servers=127.15.37.20:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:36425
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 21:05:19.142930 30505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:19.143312 30505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:19.143356 30505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:19.145797 30505 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:05:19.145877 30505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:19.145905 30505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:19.145931 30505 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:05:19.145964 30505 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:05:19.148849 30505 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:36425
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:36425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:19.149214 30505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:19.149665 30505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:19.155376 30518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:19.155381 30515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:19.155390 30514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:19.155645 30505 server_base.cc:1034] running on GCE node
I20260810 21:05:19.155985 30505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:19.156436 30505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:19.157721 30505 hybrid_clock.cc:648] HybridClock initialized: now 1786395919157697 us; error 42 us; skew 500 ppm
I20260810 21:05:19.159071 30505 webserver.cc:460] Webserver started at http://127.15.37.62:33221/ using document root <none> and password file <none>
I20260810 21:05:19.159291 30505 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:19.159334 30505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:19.159451 30505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:19.160732 30505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "24f874813cbe4373a33ef1bb0b33aa0f"
format_stamp: "Formatted at 2026-08-10 21:05:19 on dist-test-slave-jq4t"
server_key: "4335908cc2cda1ccdfc43063d6624253"
server_key_iv: "b2e4c2e606f997589306dbcb6fd6764b"
server_key_version: "encryptionkey@0"
I20260810 21:05:19.161121 30505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "24f874813cbe4373a33ef1bb0b33aa0f"
format_stamp: "Formatted at 2026-08-10 21:05:19 on dist-test-slave-jq4t"
server_key: "4335908cc2cda1ccdfc43063d6624253"
server_key_iv: "b2e4c2e606f997589306dbcb6fd6764b"
server_key_version: "encryptionkey@0"
I20260810 21:05:19.162539 30505 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:05:19.163333 30528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:19.163537 30505 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:05:19.163646 30505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "24f874813cbe4373a33ef1bb0b33aa0f"
format_stamp: "Formatted at 2026-08-10 21:05:19 on dist-test-slave-jq4t"
server_key: "4335908cc2cda1ccdfc43063d6624253"
server_key_iv: "b2e4c2e606f997589306dbcb6fd6764b"
server_key_version: "encryptionkey@0"
I20260810 21:05:19.163722 30505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:19.167289 30505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:19.167586 30505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:19.167732 30505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:19.172014 30505 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:36425
I20260810 21:05:19.172058 30619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:36425 every 8 connection(s)
I20260810 21:05:19.172423 30505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:05:19.173168 30620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:05:19.175998 30620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f: Bootstrap starting.
I20260810 21:05:19.176692 30620 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f: Neither blocks nor log segments found. Creating new log.
I20260810 21:05:19.177004 30620 log.cc:824] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f: Log is configured to *not* fsync() on all Append() calls
I20260810 21:05:19.177708 30620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f: No bootstrap required, opened a new log
I20260810 21:05:19.179337 30620 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f874813cbe4373a33ef1bb0b33aa0f" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36425 } }
I20260810 21:05:19.179498 30620 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:05:19.179543 30620 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24f874813cbe4373a33ef1bb0b33aa0f, State: Initialized, Role: FOLLOWER
I20260810 21:05:19.179701 30620 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f874813cbe4373a33ef1bb0b33aa0f" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36425 } }
I20260810 21:05:19.179808 30620 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:05:19.179847 30620 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:05:19.179910 30620 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:05:19.179948 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 30505
I20260810 21:05:19.180068 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:05:19.180259 15508 external_mini_cluster.cc:1428] Setting key 691fbaa6e8e78be6f5ee1a49fc486879
I20260810 21:05:19.180794 30620 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f874813cbe4373a33ef1bb0b33aa0f" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36425 } }
I20260810 21:05:19.180918 30620 leader_election.cc:302] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24f874813cbe4373a33ef1bb0b33aa0f; no voters:
I20260810 21:05:19.181107 30620 leader_election.cc:288] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:05:19.181135 30626 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:05:19.181318 30626 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [term 1 LEADER]: Becoming Leader. State: Replica: 24f874813cbe4373a33ef1bb0b33aa0f, State: Running, Role: LEADER
I20260810 21:05:19.181387 30620 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:05:19.181464 30626 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f874813cbe4373a33ef1bb0b33aa0f" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36425 } }
I20260810 21:05:19.182174 30628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24f874813cbe4373a33ef1bb0b33aa0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f874813cbe4373a33ef1bb0b33aa0f" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36425 } } }
I20260810 21:05:19.182263 30628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [sys.catalog]: This master's current role is: LEADER
I20260810 21:05:19.182861 30645 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:05:19.183638 30625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:19.180846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60474 (local address 127.15.37.62:36425)
0810 21:05:19.181164 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:19.181174 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:19.181212 (+ 38us) server_negotiation.cc:407] Connection header received
0810 21:05:19.181338 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:19.181345 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:19.181391 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:19.181821 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:19.183085 (+ 1264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:19.183090 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:19.183090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:05:19.183095 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:19.183145 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:05:19.183161 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:19.183237 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:19.183347 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 21:05:19.183412 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":105,"threads_started":1}
I20260810 21:05:19.183727 30645 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:05:19.182909 30631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24f874813cbe4373a33ef1bb0b33aa0f. Latest consensus state: current_term: 1 leader_uuid: "24f874813cbe4373a33ef1bb0b33aa0f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24f874813cbe4373a33ef1bb0b33aa0f" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36425 } } }
I20260810 21:05:19.183964 30631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f [sys.catalog]: This master's current role is: LEADER
I20260810 21:05:19.185374 30645 catalog_manager.cc:1347] Generated new cluster ID: c5047912b4264241b8da0f2450da6982
I20260810 21:05:19.185415 30645 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:05:19.202335 30645 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:05:19.202634 30645 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:05:19.208375 30645 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24f874813cbe4373a33ef1bb0b33aa0f: Generated new TSK 0
I20260810 21:05:19.208669 30645 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:05:19.212839 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36425
--builtin_ntp_servers=127.15.37.20:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 21:05:19.303498 30662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:19.303766 30662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:19.303807 30662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:19.305153 30662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:19.305223 30662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:19.305269 30662 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:05:19.307396 30662 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:19.307818 30662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:19.308207 30662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:19.314739 30669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:19.314740 30670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:19.314766 30672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:19.315130 30662 server_base.cc:1034] running on GCE node
I20260810 21:05:19.315359 30662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:19.315649 30662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:19.316828 30662 hybrid_clock.cc:648] HybridClock initialized: now 1786395919316808 us; error 27 us; skew 500 ppm
I20260810 21:05:19.318323 30662 webserver.cc:460] Webserver started at http://127.15.37.1:46335/ using document root <none> and password file <none>
I20260810 21:05:19.318634 30662 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:19.318714 30662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:19.318879 30662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:19.320065 30662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "d19ae3dd261642e5b1343d82be3a8bf5"
format_stamp: "Formatted at 2026-08-10 21:05:19 on dist-test-slave-jq4t"
server_key: "9f77c1bf79348029f8a874937323a718"
server_key_iv: "70171727a7e2c4997de325b0bfeafcbb"
server_key_version: "encryptionkey@0"
I20260810 21:05:19.320470 30662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "d19ae3dd261642e5b1343d82be3a8bf5"
format_stamp: "Formatted at 2026-08-10 21:05:19 on dist-test-slave-jq4t"
server_key: "9f77c1bf79348029f8a874937323a718"
server_key_iv: "70171727a7e2c4997de325b0bfeafcbb"
server_key_version: "encryptionkey@0"
I20260810 21:05:19.322085 30662 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:05:19.322960 30681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:19.323203 30662 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:05:19.323333 30662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "d19ae3dd261642e5b1343d82be3a8bf5"
format_stamp: "Formatted at 2026-08-10 21:05:19 on dist-test-slave-jq4t"
server_key: "9f77c1bf79348029f8a874937323a718"
server_key_iv: "70171727a7e2c4997de325b0bfeafcbb"
server_key_version: "encryptionkey@0"
I20260810 21:05:19.323433 30662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:19.327067 30662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:19.327382 30662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:19.327541 30662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:19.327893 30662 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:19.328280 30662 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:19.328341 30662 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:19.328377 30662 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:19.328405 30662 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:19.334864 30662 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:40263
I20260810 21:05:19.334896 30846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:40263 every 8 connection(s)
I20260810 21:05:19.335280 30662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:05:19.338718 30625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:19.336175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:43613 (local address 127.15.37.62:36425)
0810 21:05:19.336291 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:19.336294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:19.336525 (+ 231us) server_negotiation.cc:407] Connection header received
0810 21:05:19.337099 (+ 574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:19.337101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:19.337111 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:19.337176 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:19.338432 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:19.338434 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:19.338435 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:05:19.338440 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:19.338460 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:05:19.338467 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:19.338543 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:19.338624 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 21:05:19.338643 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260810 21:05:19.338923 30855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:19.336073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36425 (local address 127.15.37.1:43613)
0810 21:05:19.336353 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:19.336403 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:19.336980 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:19.337254 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:19.337258 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:19.337268 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:19.338268 (+ 1000us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:05:19.338268 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:19.338298 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:05:19.338329 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:05:19.338542 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:05:19.338549 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:05:19.338553 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:05:19.338624 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 21:05:19.338694 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":120,"threads_started":1}
I20260810 21:05:19.339387 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 30662
I20260810 21:05:19.339522 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:05:19.339564 30852 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36425
I20260810 21:05:19.339686 30852 heartbeater.cc:464] Registering TS with master...
I20260810 21:05:19.339763 15508 external_mini_cluster.cc:1428] Setting key b55deb95531eaa03d2825eb959098d32
I20260810 21:05:19.339875 30852 heartbeater.cc:511] Master 127.15.37.62:36425 requested a full tablet report, sending...
I20260810 21:05:19.340590 30552 ts_manager.cc:194] Registered new tserver with Master: d19ae3dd261642e5b1343d82be3a8bf5 (127.15.37.1:40263)
I20260810 21:05:19.340829 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36425
--builtin_ntp_servers=127.15.37.20:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 21:05:19.434062 30856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:19.434302 30856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:19.434327 30856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:19.435495 30856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:19.435534 30856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:19.435560 30856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:05:19.436959 30856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:19.437191 30856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:19.437470 30856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:19.442930 30873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:19.442909 30856 server_base.cc:1034] running on GCE node
W20260810 21:05:19.442945 30869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:19.443046 30868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:19.443470 30856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:19.443701 30856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:19.444862 30856 hybrid_clock.cc:648] HybridClock initialized: now 1786395919444836 us; error 44 us; skew 500 ppm
I20260810 21:05:19.446350 30856 webserver.cc:460] Webserver started at http://127.15.37.2:35647/ using document root <none> and password file <none>
I20260810 21:05:19.446643 30856 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:19.446713 30856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:19.446887 30856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:19.448014 30856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "5e93a0e424ab4d9b866f029701208530"
format_stamp: "Formatted at 2026-08-10 21:05:19 on dist-test-slave-jq4t"
server_key: "732bc33c08d5a85de346f840617a916a"
server_key_iv: "7f17a6253fc4ca14d7ed4cc06869e30d"
server_key_version: "encryptionkey@0"
I20260810 21:05:19.448406 30856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "5e93a0e424ab4d9b866f029701208530"
format_stamp: "Formatted at 2026-08-10 21:05:19 on dist-test-slave-jq4t"
server_key: "732bc33c08d5a85de346f840617a916a"
server_key_iv: "7f17a6253fc4ca14d7ed4cc06869e30d"
server_key_version: "encryptionkey@0"
I20260810 21:05:19.449942 30856 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:05:19.450865 30884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:19.451092 30856 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:05:19.451201 30856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "5e93a0e424ab4d9b866f029701208530"
format_stamp: "Formatted at 2026-08-10 21:05:19 on dist-test-slave-jq4t"
server_key: "732bc33c08d5a85de346f840617a916a"
server_key_iv: "7f17a6253fc4ca14d7ed4cc06869e30d"
server_key_version: "encryptionkey@0"
I20260810 21:05:19.451293 30856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:19.454970 30856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:19.455261 30856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:19.455415 30856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:19.455642 30856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:19.455976 30856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:19.456035 30856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:19.456077 30856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:19.456105 30856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:19.462132 30856 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:45537
I20260810 21:05:19.462173 31058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:45537 every 8 connection(s)
I20260810 21:05:19.462551 30856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:05:19.465842 30625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:19.463440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:53407 (local address 127.15.37.62:36425)
0810 21:05:19.463533 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:19.463535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:19.463735 (+ 200us) server_negotiation.cc:407] Connection header received
0810 21:05:19.464212 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:19.464213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:19.464220 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:19.464282 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:19.465637 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:19.465639 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:19.465639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:05:19.465643 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:19.465661 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:05:19.465666 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:19.465719 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:19.465770 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 21:05:19.465783 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 21:05:19.466032 31064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:19.463391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36425 (local address 127.15.37.2:53407)
0810 21:05:19.463610 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:19.463646 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:19.464126 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:19.464346 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:19.464349 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:19.464357 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:19.465482 (+ 1125us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:05:19.465483 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:19.465513 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:05:19.465545 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:05:19.465716 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:05:19.465718 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:05:19.465720 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 21:05:19.465768 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 21:05:19.465820 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":102,"threads_started":1}
I20260810 21:05:19.466679 31061 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36425
I20260810 21:05:19.466768 31061 heartbeater.cc:464] Registering TS with master...
I20260810 21:05:19.466894 31061 heartbeater.cc:511] Master 127.15.37.62:36425 requested a full tablet report, sending...
I20260810 21:05:19.467199 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 30856
I20260810 21:05:19.467317 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:05:19.467345 30552 ts_manager.cc:194] Registered new tserver with Master: 5e93a0e424ab4d9b866f029701208530 (127.15.37.2:45537)
I20260810 21:05:19.467530 15508 external_mini_cluster.cc:1428] Setting key 5901e91622ff8277c96cd26a4b50bb40
I20260810 21:05:19.468848 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36425
--builtin_ntp_servers=127.15.37.20:44431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 21:05:19.555819 31065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:19.556090 31065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:19.556130 31065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:19.557463 31065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:19.557541 31065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:19.557587 31065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:05:19.559113 31065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36425
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:19.559432 31065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:19.559790 31065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:19.565192 31074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:19.565236 31076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:19.565207 31078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:19.565387 31065 server_base.cc:1034] running on GCE node
I20260810 21:05:19.565632 31065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:19.565939 31065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:19.567107 31065 hybrid_clock.cc:648] HybridClock initialized: now 1786395919567085 us; error 55 us; skew 500 ppm
I20260810 21:05:19.568441 31065 webserver.cc:460] Webserver started at http://127.15.37.3:42021/ using document root <none> and password file <none>
I20260810 21:05:19.568744 31065 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:19.568816 31065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:19.568982 31065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:19.570147 31065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "a3a5638808fc478b999aa2fd1ffdf951"
format_stamp: "Formatted at 2026-08-10 21:05:19 on dist-test-slave-jq4t"
server_key: "19cf5391a932387fcc207ecef49677a4"
server_key_iv: "8f3f23a45b907b801b6b23dde273bfe5"
server_key_version: "encryptionkey@0"
I20260810 21:05:19.570536 31065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "a3a5638808fc478b999aa2fd1ffdf951"
format_stamp: "Formatted at 2026-08-10 21:05:19 on dist-test-slave-jq4t"
server_key: "19cf5391a932387fcc207ecef49677a4"
server_key_iv: "8f3f23a45b907b801b6b23dde273bfe5"
server_key_version: "encryptionkey@0"
I20260810 21:05:19.571986 31065 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:05:19.572907 31087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:19.573144 31065 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:05:19.573266 31065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "a3a5638808fc478b999aa2fd1ffdf951"
format_stamp: "Formatted at 2026-08-10 21:05:19 on dist-test-slave-jq4t"
server_key: "19cf5391a932387fcc207ecef49677a4"
server_key_iv: "8f3f23a45b907b801b6b23dde273bfe5"
server_key_version: "encryptionkey@0"
I20260810 21:05:19.573350 31065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:19.576901 31065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:19.577200 31065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:19.577353 31065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:19.577577 31065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:19.577909 31065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:19.577965 31065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:19.578008 31065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:19.578037 31065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:19.584805 31065 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:33613
I20260810 21:05:19.584847 31253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:33613 every 8 connection(s)
I20260810 21:05:19.585233 31065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:05:19.588532 30625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:19.586071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:50109 (local address 127.15.37.62:36425)
0810 21:05:19.586134 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:19.586136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:19.586370 (+ 234us) server_negotiation.cc:407] Connection header received
0810 21:05:19.586845 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:19.586846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:19.586852 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:19.586916 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:19.588251 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:19.588252 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:19.588253 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:05:19.588257 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:19.588272 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:05:19.588277 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:19.588337 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:19.588401 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 21:05:19.588416 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 21:05:19.588755 31258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:19.586038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36425 (local address 127.15.37.3:50109)
0810 21:05:19.586235 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:19.586279 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:19.586757 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:19.586996 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:19.587000 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:19.587009 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:19.588081 (+ 1072us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:05:19.588081 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:19.588114 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:05:19.588146 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:05:19.588336 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:05:19.588339 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:05:19.588341 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 21:05:19.588401 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 21:05:19.588455 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
I20260810 21:05:19.589239 31255 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36425
I20260810 21:05:19.589337 31255 heartbeater.cc:464] Registering TS with master...
I20260810 21:05:19.589471 31255 heartbeater.cc:511] Master 127.15.37.62:36425 requested a full tablet report, sending...
I20260810 21:05:19.589820 30552 ts_manager.cc:194] Registered new tserver with Master: a3a5638808fc478b999aa2fd1ffdf951 (127.15.37.3:33613)
I20260810 21:05:19.594944 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 31065
I20260810 21:05:19.595036 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:05:19.595204 15508 external_mini_cluster.cc:1428] Setting key 33e579bb83181255e60a54e4debc5d8e
I20260810 21:05:19.596439 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 21:05:19.598822 30625 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:05:19.598015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60480 (local address 127.15.37.62:36425)
0810 21:05:19.598093 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:19.598096 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:19.598262 (+ 166us) server_negotiation.cc:407] Connection header received
0810 21:05:19.598375 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:19.598376 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:19.598383 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:19.598451 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:19.598722 (+ 271us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60480: BlockingRecv error: recv got EOF from 127.0.0.1:60480 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 21:05:19.598829 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 30662
I20260810 21:05:19.614768 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 30856
I20260810 21:05:19.634686 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 31065
I20260810 21:05:19.654520 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 30505
2026-08-10T21:05:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (656 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:05:19 dist-test-slave-jq4t krb5kdc[31268](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:05:19 dist-test-slave-jq4t krb5kdc[31268](info): set up 2 sockets
Aug 10 21:05:19 dist-test-slave-jq4t krb5kdc[31268](info): commencing operation
krb5kdc: starting...
W20260810 21:05:20.929512 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.244s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:05:21 dist-test-slave-jq4t krb5kdc[31268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:05:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:05:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:05:21.064316 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:33363
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:40689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:33363
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:05:21.153287 31285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:21.153522 31285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:21.153546 31285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:21.154706 31285 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:05:21.154748 31285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:21.154762 31285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:21.154775 31285 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:05:21.154788 31285 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:05:21.156356 31285 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:40689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:33363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:33363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:21.156629 31285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:21.156831 31285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:21.162674 31293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:21.162680 31295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:21.162933 31285 server_base.cc:1034] running on GCE node
W20260810 21:05:21.162680 31292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:21.163285 31285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:21.163647 31285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:21.164822 31285 hybrid_clock.cc:648] HybridClock initialized: now 1786395921164814 us; error 59 us; skew 500 ppm
Aug 10 21:05:21 dist-test-slave-jq4t krb5kdc[31268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395921, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:05:21.167552 31285 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:05:21.167982 31285 webserver.cc:460] Webserver started at http://127.15.37.62:43033/ using document root <none> and password file <none>
I20260810 21:05:21.168211 31285 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:21.168255 31285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:21.168354 31285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:21.169520 31285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "92f02b39e9f44ce6ada2e2b1b4ea6780"
format_stamp: "Formatted at 2026-08-10 21:05:21 on dist-test-slave-jq4t"
server_key: "7994e509a07dfc1bfb8f4ded8ce63701"
server_key_iv: "4853d0d9342e94c88836ee4018b41af4"
server_key_version: "encryptionkey@0"
I20260810 21:05:21.169852 31285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "92f02b39e9f44ce6ada2e2b1b4ea6780"
format_stamp: "Formatted at 2026-08-10 21:05:21 on dist-test-slave-jq4t"
server_key: "7994e509a07dfc1bfb8f4ded8ce63701"
server_key_iv: "4853d0d9342e94c88836ee4018b41af4"
server_key_version: "encryptionkey@0"
I20260810 21:05:21.171301 31285 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:05:21.172214 31308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:21.172464 31285 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:05:21.172621 31285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "92f02b39e9f44ce6ada2e2b1b4ea6780"
format_stamp: "Formatted at 2026-08-10 21:05:21 on dist-test-slave-jq4t"
server_key: "7994e509a07dfc1bfb8f4ded8ce63701"
server_key_iv: "4853d0d9342e94c88836ee4018b41af4"
server_key_version: "encryptionkey@0"
I20260810 21:05:21.172709 31285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:21.187265 31285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:21.189643 31285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:21.189811 31285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:21.194489 31285 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:33363
I20260810 21:05:21.194532 31393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:33363 every 8 connection(s)
I20260810 21:05:21.194939 31285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:05:21.196066 31394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:05:21.198588 31394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780: Bootstrap starting.
I20260810 21:05:21.199262 31394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780: Neither blocks nor log segments found. Creating new log.
I20260810 21:05:21.199601 31394 log.cc:824] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780: Log is configured to *not* fsync() on all Append() calls
I20260810 21:05:21.200461 31394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780: No bootstrap required, opened a new log
I20260810 21:05:21.200754 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 31285
I20260810 21:05:21.200877 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:05:21.201092 15508 external_mini_cluster.cc:1428] Setting key 53becf238a57d631d1a567c7a6cc1d2b
I20260810 21:05:21.202884 31394 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f02b39e9f44ce6ada2e2b1b4ea6780" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 33363 } }
I20260810 21:05:21.203065 31394 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:05:21.203105 31394 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92f02b39e9f44ce6ada2e2b1b4ea6780, State: Initialized, Role: FOLLOWER
I20260810 21:05:21.203280 31394 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f02b39e9f44ce6ada2e2b1b4ea6780" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 33363 } }
I20260810 21:05:21.203380 31394 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:05:21.203428 31394 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:05:21.203487 31394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:05:21.204649 31394 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f02b39e9f44ce6ada2e2b1b4ea6780" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 33363 } }
I20260810 21:05:21.204756 31394 leader_election.cc:302] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92f02b39e9f44ce6ada2e2b1b4ea6780; no voters:
I20260810 21:05:21.204967 31394 leader_election.cc:288] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:05:21.205016 31402 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:05:21.205163 31402 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [term 1 LEADER]: Becoming Leader. State: Replica: 92f02b39e9f44ce6ada2e2b1b4ea6780, State: Running, Role: LEADER
I20260810 21:05:21.205269 31394 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:05:21.205325 31402 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f02b39e9f44ce6ada2e2b1b4ea6780" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 33363 } }
I20260810 21:05:21.205770 31404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92f02b39e9f44ce6ada2e2b1b4ea6780" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f02b39e9f44ce6ada2e2b1b4ea6780" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 33363 } } }
I20260810 21:05:21.205892 31404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [sys.catalog]: This master's current role is: LEADER
I20260810 21:05:21.205766 31408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92f02b39e9f44ce6ada2e2b1b4ea6780. Latest consensus state: current_term: 1 leader_uuid: "92f02b39e9f44ce6ada2e2b1b4ea6780" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92f02b39e9f44ce6ada2e2b1b4ea6780" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 33363 } } }
I20260810 21:05:21.206125 31408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780 [sys.catalog]: This master's current role is: LEADER
I20260810 21:05:21.206238 31416 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:05:21.206815 31416 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:05:21.208811 31416 catalog_manager.cc:1347] Generated new cluster ID: a92bafadc5cd4004852bde6fe546f090
I20260810 21:05:21.208876 31416 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:05:21 dist-test-slave-jq4t krb5kdc[31268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395921, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:05:21.213574 31416 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:05:21.214187 31416 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:05:21.214598 31401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.201695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58922 (local address 127.15.37.62:33363)
0810 21:05:21.201872 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:21.201882 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:21.201920 (+ 38us) server_negotiation.cc:407] Connection header received
0810 21:05:21.202852 (+ 932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:21.202861 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:21.202928 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:21.203051 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:21.203928 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.205453 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.206661 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.207443 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.207973 (+ 530us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.210548 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:21.210553 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:21.210553 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:05:21.210566 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:21.212701 (+ 2135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:21.213129 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:21.213132 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:21.213132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:21.213286 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:21.213566 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:21.213567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:21.213568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:21.213931 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:21.214102 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:21.214213 (+ 111us) server_negotiation.cc:299] Negotiation successful
0810 21:05:21.214388 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":92,"threads_started":1}
I20260810 21:05:21.227968 31416 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780: Generated new TSK 0
I20260810 21:05:21.228263 31416 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:05:21.264626 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:33363
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:40689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:05:21.352180 31440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:21.352399 31440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:21.352424 31440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:21.353603 31440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:21.353648 31440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:21.353675 31440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:05:21.355338 31440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:40689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:33363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:21.355542 31440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:21.355729 31440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:21.361220 31453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:21.361220 31458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:21.361281 31455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:21.361574 31440 server_base.cc:1034] running on GCE node
I20260810 21:05:21.361826 31440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:21.362128 31440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:21.363300 31440 hybrid_clock.cc:648] HybridClock initialized: now 1786395921363278 us; error 43 us; skew 500 ppm
Aug 10 21:05:21 dist-test-slave-jq4t krb5kdc[31268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395921, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:05:21.366219 31440 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:05:21.366696 31440 webserver.cc:460] Webserver started at http://127.15.37.1:42857/ using document root <none> and password file <none>
I20260810 21:05:21.366936 31440 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:21.366983 31440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:21.367134 31440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:21.368283 31440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "bf232705556448e5b0fd0a37dca75e19"
format_stamp: "Formatted at 2026-08-10 21:05:21 on dist-test-slave-jq4t"
server_key: "c7e91c565c6878bd9a9c9401ffe16605"
server_key_iv: "75a46b4877996ffae7ad52cef70b51cd"
server_key_version: "encryptionkey@0"
I20260810 21:05:21.368734 31440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "bf232705556448e5b0fd0a37dca75e19"
format_stamp: "Formatted at 2026-08-10 21:05:21 on dist-test-slave-jq4t"
server_key: "c7e91c565c6878bd9a9c9401ffe16605"
server_key_iv: "75a46b4877996ffae7ad52cef70b51cd"
server_key_version: "encryptionkey@0"
I20260810 21:05:21.370098 31440 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:05:21.370927 31472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:21.371124 31440 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 21:05:21.371203 31440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "bf232705556448e5b0fd0a37dca75e19"
format_stamp: "Formatted at 2026-08-10 21:05:21 on dist-test-slave-jq4t"
server_key: "c7e91c565c6878bd9a9c9401ffe16605"
server_key_iv: "75a46b4877996ffae7ad52cef70b51cd"
server_key_version: "encryptionkey@0"
I20260810 21:05:21.371260 31440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:21.394127 31440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:21.396697 31440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:21.396823 31440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:21.397037 31440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:21.397404 31440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:21.397473 31440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:21.397521 31440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:21.397550 31440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:21.403574 31440 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:36237
I20260810 21:05:21.403663 31646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:36237 every 8 connection(s)
I20260810 21:05:21.404017 31440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
Aug 10 21:05:21 dist-test-slave-jq4t krb5kdc[31268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395921, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:05:21.410987 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 31440
I20260810 21:05:21.411106 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:05:21.411316 15508 external_mini_cluster.cc:1428] Setting key edc3367c76425297b0b6be2bd5cb4c2f
I20260810 21:05:21.414306 31401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.404846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:43205 (local address 127.15.37.62:33363)
0810 21:05:21.404923 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:21.404925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:21.405145 (+ 220us) server_negotiation.cc:407] Connection header received
0810 21:05:21.405683 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:21.405684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:21.405696 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:21.405756 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:21.406834 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.407421 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.408410 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.408677 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.408731 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.410883 (+ 2152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:21.410885 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:21.410885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:05:21.410896 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:21.412634 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:21.413172 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:21.413173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:21.413174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:21.413227 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:21.413515 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:21.413516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:21.413516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:21.413626 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:21.413679 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:21.414066 (+ 387us) server_negotiation.cc:299] Negotiation successful
0810 21:05:21.414175 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 21:05:21.414395 31651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.404821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:33363 (local address 127.15.37.1:43205)
0810 21:05:21.404999 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:21.405051 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:21.405592 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:21.405844 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:21.405848 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:21.406546 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:21.406748 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:21.406753 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.407508 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.407509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:21.408334 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:21.408336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.408752 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.408752 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:21.408861 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.409333 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:21.409342 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:21.410770 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:05:21.412714 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:05:21.412723 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:05:21.412725 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:05:21.413092 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:05:21.413295 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:05:21.413296 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:05:21.413297 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:05:21.413449 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:05:21.413692 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:05:21.413698 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:05:21.413885 (+ 187us) client_negotiation.cc:769] Sending connection context
0810 21:05:21.414017 (+ 132us) client_negotiation.cc:240] Negotiation successful
0810 21:05:21.414193 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":97,"threads_started":1}
I20260810 21:05:21.415125 31647 heartbeater.cc:347] Connected to a master server at 127.15.37.62:33363
I20260810 21:05:21.415239 31647 heartbeater.cc:464] Registering TS with master...
I20260810 21:05:21.415452 31647 heartbeater.cc:511] Master 127.15.37.62:33363 requested a full tablet report, sending...
I20260810 21:05:21.416041 31339 ts_manager.cc:194] Registered new tserver with Master: bf232705556448e5b0fd0a37dca75e19 (127.15.37.1:36237)
I20260810 21:05:21.416781 31339 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:43205
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:05:21.439985 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:33363
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:40689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:05:21.526292 31656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:21.526516 31656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:21.526542 31656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:21.527645 31656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:21.527683 31656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:21.527709 31656 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:05:21.529217 31656 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:40689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:33363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:21.529446 31656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:21.529637 31656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:21.535153 31667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:21.535175 31664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:21.535181 31661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:21.535207 31656 server_base.cc:1034] running on GCE node
I20260810 21:05:21.535560 31656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:21.535837 31656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:21.537024 31656 hybrid_clock.cc:648] HybridClock initialized: now 1786395921537012 us; error 31 us; skew 500 ppm
Aug 10 21:05:21 dist-test-slave-jq4t krb5kdc[31268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395921, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:05:21.539611 31656 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:05:21.540123 31656 webserver.cc:460] Webserver started at http://127.15.37.2:41051/ using document root <none> and password file <none>
I20260810 21:05:21.540361 31656 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:21.540429 31656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:21.540625 31656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:21.541728 31656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "2203704b55e040a0b5a69564e352d95d"
format_stamp: "Formatted at 2026-08-10 21:05:21 on dist-test-slave-jq4t"
server_key: "7e192118b5327ed8f8ba3957083666d2"
server_key_iv: "5207fdb98af715effc169144d6c1fa8b"
server_key_version: "encryptionkey@0"
I20260810 21:05:21.542116 31656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "2203704b55e040a0b5a69564e352d95d"
format_stamp: "Formatted at 2026-08-10 21:05:21 on dist-test-slave-jq4t"
server_key: "7e192118b5327ed8f8ba3957083666d2"
server_key_iv: "5207fdb98af715effc169144d6c1fa8b"
server_key_version: "encryptionkey@0"
I20260810 21:05:21.543497 31656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:05:21.544251 31681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:21.544443 31656 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:05:21.544595 31656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "2203704b55e040a0b5a69564e352d95d"
format_stamp: "Formatted at 2026-08-10 21:05:21 on dist-test-slave-jq4t"
server_key: "7e192118b5327ed8f8ba3957083666d2"
server_key_iv: "5207fdb98af715effc169144d6c1fa8b"
server_key_version: "encryptionkey@0"
I20260810 21:05:21.544667 31656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:21.556408 31656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:21.558512 31656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:21.558674 31656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:21.558916 31656 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:21.559250 31656 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:21.559285 31656 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:21.559327 31656 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:21.559355 31656 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:21.565460 31656 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:44491
I20260810 21:05:21.565507 31847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:44491 every 8 connection(s)
I20260810 21:05:21.565850 31656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
Aug 10 21:05:21 dist-test-slave-jq4t krb5kdc[31268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395921, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:05:21.575847 31401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.566604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:51771 (local address 127.15.37.62:33363)
0810 21:05:21.566653 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:21.566655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:21.566959 (+ 304us) server_negotiation.cc:407] Connection header received
0810 21:05:21.567522 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:21.567524 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:21.567538 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:21.567595 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:21.568726 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.569250 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.570294 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.570499 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.570589 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.572936 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:21.572937 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:21.572937 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:05:21.572945 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:21.574414 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:21.574817 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:21.574818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:21.574819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:21.574874 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:21.575225 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:21.575226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:21.575227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:21.575383 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:21.575453 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:21.575707 (+ 254us) server_negotiation.cc:299] Negotiation successful
0810 21:05:21.575777 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 21:05:21.576135 31852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.566566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:33363 (local address 127.15.37.2:51771)
0810 21:05:21.566762 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:21.566829 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:21.567389 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:21.567684 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:21.567688 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:21.568314 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:21.568615 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:21.568620 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.569356 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.569357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:21.570197 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:21.570199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.570602 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.570603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:21.570742 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.571355 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:21.571364 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:21.572833 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:05:21.574491 (+ 1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:05:21.574498 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:05:21.574500 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:05:21.574750 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:05:21.574965 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:05:21.574966 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:05:21.574966 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:05:21.575103 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:05:21.575455 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:05:21.575461 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:05:21.575589 (+ 128us) client_negotiation.cc:769] Sending connection context
0810 21:05:21.575678 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 21:05:21.575854 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":99,"threads_started":1}
I20260810 21:05:21.576153 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 31656
I20260810 21:05:21.576285 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:05:21.576624 15508 external_mini_cluster.cc:1428] Setting key 54330b329f1854f2d290137d221c4cf8
I20260810 21:05:21.576849 31849 heartbeater.cc:347] Connected to a master server at 127.15.37.62:33363
I20260810 21:05:21.576977 31849 heartbeater.cc:464] Registering TS with master...
I20260810 21:05:21.577221 31849 heartbeater.cc:511] Master 127.15.37.62:33363 requested a full tablet report, sending...
I20260810 21:05:21.577627 31339 ts_manager.cc:194] Registered new tserver with Master: 2203704b55e040a0b5a69564e352d95d (127.15.37.2:44491)
I20260810 21:05:21.578033 31339 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:51771
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:05:21.604400 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:33363
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:40689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:05:21.691072 31858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:05:21.691295 31858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:05:21.691320 31858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:05:21.692602 31858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:05:21.692646 31858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:05:21.692673 31858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:05:21.694243 31858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:40689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:33363
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:05:21.694519 31858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:05:21.694770 31858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:05:21.700027 31865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:21.700045 31868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:05:21.700062 31871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:05:21.700438 31858 server_base.cc:1034] running on GCE node
I20260810 21:05:21.700698 31858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:05:21.700981 31858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:05:21.702155 31858 hybrid_clock.cc:648] HybridClock initialized: now 1786395921702132 us; error 38 us; skew 500 ppm
Aug 10 21:05:21 dist-test-slave-jq4t krb5kdc[31268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395921, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:05:21.705163 31858 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:05:21.705713 31858 webserver.cc:460] Webserver started at http://127.15.37.3:35891/ using document root <none> and password file <none>
I20260810 21:05:21.705965 31858 fs_manager.cc:359] Metadata directory not provided
I20260810 21:05:21.706043 31858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:05:21.706202 31858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:05:21.707377 31858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "154d9c25beba48da91e8307e12af871f"
format_stamp: "Formatted at 2026-08-10 21:05:21 on dist-test-slave-jq4t"
server_key: "37d86fc10baf4b1557aeb9de70a25a55"
server_key_iv: "3a64cf67f733a910c0d3cd662316f128"
server_key_version: "encryptionkey@0"
I20260810 21:05:21.707765 31858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "154d9c25beba48da91e8307e12af871f"
format_stamp: "Formatted at 2026-08-10 21:05:21 on dist-test-slave-jq4t"
server_key: "37d86fc10baf4b1557aeb9de70a25a55"
server_key_iv: "3a64cf67f733a910c0d3cd662316f128"
server_key_version: "encryptionkey@0"
I20260810 21:05:21.709245 31858 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:05:21.710057 31880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:21.710215 31858 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 21:05:21.710326 31858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "154d9c25beba48da91e8307e12af871f"
format_stamp: "Formatted at 2026-08-10 21:05:21 on dist-test-slave-jq4t"
server_key: "37d86fc10baf4b1557aeb9de70a25a55"
server_key_iv: "3a64cf67f733a910c0d3cd662316f128"
server_key_version: "encryptionkey@0"
I20260810 21:05:21.710405 31858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:05:21.723547 31858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:05:21.725819 31858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:05:21.725973 31858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:05:21.726220 31858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:05:21.726555 31858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:05:21.726590 31858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:21.726634 31858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:05:21.726660 31858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:05:21.732703 31858 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:39525
I20260810 21:05:21.732782 32065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:39525 every 8 connection(s)
I20260810 21:05:21.733117 31858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
Aug 10 21:05:21 dist-test-slave-jq4t krb5kdc[31268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395921, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:05:21.740684 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 31858
I20260810 21:05:21.740799 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:05:21.741001 15508 external_mini_cluster.cc:1428] Setting key 1df245eb2185613f7d8493f45a88707f
I20260810 21:05:21.742892 31401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.733880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:50095 (local address 127.15.37.62:33363)
0810 21:05:21.733973 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:21.733975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:21.734195 (+ 220us) server_negotiation.cc:407] Connection header received
0810 21:05:21.734694 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:21.734695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:21.734709 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:21.734774 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:21.735767 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.736323 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.737395 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.737604 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.737664 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.739828 (+ 2164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:21.739829 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:21.739829 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:05:21.739837 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:21.741522 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:21.741980 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:21.741981 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:21.741981 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:21.742045 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:21.742363 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:21.742364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:21.742364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:21.742481 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:21.742538 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:21.742754 (+ 216us) server_negotiation.cc:299] Negotiation successful
0810 21:05:21.742828 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 21:05:21.743108 32069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.733837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:33363 (local address 127.15.37.3:50095)
0810 21:05:21.734037 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:21.734082 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:21.734580 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:21.734853 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:21.734856 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:21.735454 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:05:21.735658 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:21.735663 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.736414 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.736415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:21.737306 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:21.737308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.737685 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.737686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:21.737791 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.738305 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:05:21.738314 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:05:21.739736 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:05:21.741610 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:05:21.741619 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:05:21.741621 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:05:21.741906 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:05:21.742157 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:05:21.742158 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:05:21.742158 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:05:21.742315 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:05:21.742525 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:05:21.742527 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:05:21.742646 (+ 119us) client_negotiation.cc:769] Sending connection context
0810 21:05:21.742725 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 21:05:21.742855 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":112,"threads_started":1}
I20260810 21:05:21.743561 32066 heartbeater.cc:347] Connected to a master server at 127.15.37.62:33363
I20260810 21:05:21.743656 32066 heartbeater.cc:464] Registering TS with master...
I20260810 21:05:21.743813 32066 heartbeater.cc:511] Master 127.15.37.62:33363 requested a full tablet report, sending...
I20260810 21:05:21.744167 31339 ts_manager.cc:194] Registered new tserver with Master: 154d9c25beba48da91e8307e12af871f (127.15.37.3:39525)
I20260810 21:05:21.744599 31339 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:50095
I20260810 21:05:21.753249 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:05:21.761133 31401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.754673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58932 (local address 127.15.37.62:33363)
0810 21:05:21.754753 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:21.754756 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:21.754857 (+ 101us) server_negotiation.cc:407] Connection header received
0810 21:05:21.754946 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:21.754947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:21.754965 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:21.755022 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:05:21.755621 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.756126 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.756976 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.757175 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.757251 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.758494 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:05:21.758495 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:05:21.758496 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:05:21.758513 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:05:21.759813 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:21.760167 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:21.760168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:21.760168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:21.760232 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:05:21.760445 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:05:21.760446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:05:21.760446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:05:21.760672 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:05:21.760781 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:21.760941 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 21:05:21.761027 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 21:05:21.762926 31339 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58932:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:05:21.764652 31339 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:05:21.771497 32086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.767153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:36237 (local address 127.0.0.1:58810)
0810 21:05:21.767547 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:21.767556 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:21.767601 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:21.767810 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:21.767811 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:21.767815 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:05:21.767870 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:21.767872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.769281 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.769282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:21.770308 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:21.770311 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.771163 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.771164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:21.771246 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.771260 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 21:05:21.771341 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 21:05:21.771394 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":95,"threads_started":1}
I20260810 21:05:21.771525 32092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.767439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58810 (local address 127.15.37.1:36237)
0810 21:05:21.767638 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:21.767642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:21.767651 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:05:21.767686 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:21.767687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:21.767723 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:21.767818 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:05:21.767982 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.769161 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.770390 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.771069 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.771150 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.771209 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:21.771370 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 21:05:21.771414 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":82,"threads_started":1}
I20260810 21:05:21.772145 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.767250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38812 (local address 127.15.37.2:44491)
0810 21:05:21.767485 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:21.767490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:21.767501 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:05:21.767618 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:21.767620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:21.767638 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:21.767727 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:05:21.767931 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.769314 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.770710 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.771432 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.771501 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.771555 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:21.771997 (+ 442us) server_negotiation.cc:299] Negotiation successful
0810 21:05:21.772041 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":116,"threads_started":1}
I20260810 21:05:21.772140 32084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.767132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:44491 (local address 127.0.0.1:38812)
0810 21:05:21.767357 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:21.767401 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:21.767478 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:21.767756 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:21.767760 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:21.767762 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:05:21.767844 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:21.767846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.769402 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.769403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:21.770607 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:21.770610 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.771838 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.771840 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:21.771912 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.771917 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:05:21.771978 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 21:05:21.772025 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"mutex_wait_us":102,"thread_start_us":71,"threads_started":1}
I20260810 21:05:21.772439 32096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.767438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50156 (local address 127.15.37.3:39525)
0810 21:05:21.767969 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:21.767974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:21.767983 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:05:21.768045 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:21.768046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:21.768061 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:21.768140 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:05:21.768246 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.769101 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.770780 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.771415 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.771488 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.771542 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:21.772186 (+ 644us) server_negotiation.cc:299] Negotiation successful
0810 21:05:21.772358 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":85,"threads_started":1}
I20260810 21:05:21.772146 32089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:21.767153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:39525 (local address 127.0.0.1:50156)
0810 21:05:21.767677 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:21.767685 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:21.767724 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:21.768137 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:21.768138 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:21.768140 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:05:21.768180 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:21.768181 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.769362 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.769363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:21.770719 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:21.770721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:21.771859 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:21.771861 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:21.771935 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:21.771940 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:05:21.771998 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 21:05:21.772042 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":46,"thread_start_us":94,"threads_started":1}
I20260810 21:05:21.772439 31545 tablet_service.cc:1467] Processing CreateTablet for tablet 119c7afdc4864db09413d173de25af30 (DEFAULT_TABLE table=test-table [id=d5d8d3b5698540e696517ab33fb178ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:05:21.772903 31545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119c7afdc4864db09413d173de25af30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:05:21.773104 31752 tablet_service.cc:1467] Processing CreateTablet for tablet 119c7afdc4864db09413d173de25af30 (DEFAULT_TABLE table=test-table [id=d5d8d3b5698540e696517ab33fb178ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:05:21.773216 31957 tablet_service.cc:1467] Processing CreateTablet for tablet 119c7afdc4864db09413d173de25af30 (DEFAULT_TABLE table=test-table [id=d5d8d3b5698540e696517ab33fb178ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:05:21.773479 31752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119c7afdc4864db09413d173de25af30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:05:21.773512 31957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 119c7afdc4864db09413d173de25af30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:05:21.775857 32100 tablet_bootstrap.cc:492] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19: Bootstrap starting.
I20260810 21:05:21.776554 32100 tablet_bootstrap.cc:654] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19: Neither blocks nor log segments found. Creating new log.
I20260810 21:05:21.776932 32105 tablet_bootstrap.cc:492] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d: Bootstrap starting.
I20260810 21:05:21.777241 32100 log.cc:824] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19: Log is configured to *not* fsync() on all Append() calls
I20260810 21:05:21.777695 32105 tablet_bootstrap.cc:654] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d: Neither blocks nor log segments found. Creating new log.
I20260810 21:05:21.778131 32100 tablet_bootstrap.cc:492] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19: No bootstrap required, opened a new log
I20260810 21:05:21.778210 32100 ts_tablet_manager.cc:1397] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 21:05:21.778297 32105 log.cc:824] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d: Log is configured to *not* fsync() on all Append() calls
I20260810 21:05:21.778651 32103 tablet_bootstrap.cc:492] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f: Bootstrap starting.
I20260810 21:05:21.779013 32105 tablet_bootstrap.cc:492] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d: No bootstrap required, opened a new log
I20260810 21:05:21.779101 32105 ts_tablet_manager.cc:1397] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:05:21.779307 32103 tablet_bootstrap.cc:654] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f: Neither blocks nor log segments found. Creating new log.
I20260810 21:05:21.779851 32103 log.cc:824] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f: Log is configured to *not* fsync() on all Append() calls
I20260810 21:05:21.780407 32100 raft_consensus.cc:348] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2203704b55e040a0b5a69564e352d95d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 44491 } } peers { permanent_uuid: "bf232705556448e5b0fd0a37dca75e19" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36237 } } peers { permanent_uuid: "154d9c25beba48da91e8307e12af871f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39525 } }
I20260810 21:05:21.780648 32100 raft_consensus.cc:374] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:05:21.780699 32100 raft_consensus.cc:729] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf232705556448e5b0fd0a37dca75e19, State: Initialized, Role: FOLLOWER
I20260810 21:05:21.780850 32100 consensus_queue.cc:260] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2203704b55e040a0b5a69564e352d95d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 44491 } } peers { permanent_uuid: "bf232705556448e5b0fd0a37dca75e19" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36237 } } peers { permanent_uuid: "154d9c25beba48da91e8307e12af871f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39525 } }
I20260810 21:05:21.780936 32105 raft_consensus.cc:348] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2203704b55e040a0b5a69564e352d95d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 44491 } } peers { permanent_uuid: "bf232705556448e5b0fd0a37dca75e19" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36237 } } peers { permanent_uuid: "154d9c25beba48da91e8307e12af871f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39525 } }
I20260810 21:05:21.781091 32103 tablet_bootstrap.cc:492] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f: No bootstrap required, opened a new log
I20260810 21:05:21.781133 32105 raft_consensus.cc:374] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:05:21.781154 32103 ts_tablet_manager.cc:1397] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:05:21.781157 32100 ts_tablet_manager.cc:1428] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260810 21:05:21.781183 32105 raft_consensus.cc:729] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2203704b55e040a0b5a69564e352d95d, State: Initialized, Role: FOLLOWER
I20260810 21:05:21.781278 31647 heartbeater.cc:503] Master 127.15.37.62:33363 was elected leader, sending a full tablet report...
I20260810 21:05:21.781323 32105 consensus_queue.cc:260] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2203704b55e040a0b5a69564e352d95d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 44491 } } peers { permanent_uuid: "bf232705556448e5b0fd0a37dca75e19" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36237 } } peers { permanent_uuid: "154d9c25beba48da91e8307e12af871f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39525 } }
I20260810 21:05:21.781606 32105 ts_tablet_manager.cc:1428] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 21:05:21.781690 31849 heartbeater.cc:503] Master 127.15.37.62:33363 was elected leader, sending a full tablet report...
I20260810 21:05:21.783011 32103 raft_consensus.cc:348] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2203704b55e040a0b5a69564e352d95d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 44491 } } peers { permanent_uuid: "bf232705556448e5b0fd0a37dca75e19" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36237 } } peers { permanent_uuid: "154d9c25beba48da91e8307e12af871f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39525 } }
I20260810 21:05:21.783133 32103 raft_consensus.cc:374] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:05:21.783154 32103 raft_consensus.cc:729] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 154d9c25beba48da91e8307e12af871f, State: Initialized, Role: FOLLOWER
I20260810 21:05:21.783257 32103 consensus_queue.cc:260] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2203704b55e040a0b5a69564e352d95d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 44491 } } peers { permanent_uuid: "bf232705556448e5b0fd0a37dca75e19" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36237 } } peers { permanent_uuid: "154d9c25beba48da91e8307e12af871f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39525 } }
I20260810 21:05:21.783566 32103 ts_tablet_manager.cc:1428] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 21:05:21.783645 32066 heartbeater.cc:503] Master 127.15.37.62:33363 was elected leader, sending a full tablet report...
W20260810 21:05:21.816459 31850 tablet.cc:2369] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:05:21.904891 31649 tablet.cc:2369] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:05:21.983777 32067 tablet.cc:2369] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:05:22.022295 32113 raft_consensus.cc:482] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:05:22.022446 32113 raft_consensus.cc:504] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2203704b55e040a0b5a69564e352d95d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 44491 } } peers { permanent_uuid: "bf232705556448e5b0fd0a37dca75e19" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36237 } } peers { permanent_uuid: "154d9c25beba48da91e8307e12af871f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39525 } }
I20260810 21:05:22.022874 32113 leader_election.cc:288] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2203704b55e040a0b5a69564e352d95d (127.15.37.2:44491), bf232705556448e5b0fd0a37dca75e19 (127.15.37.1:36237)
I20260810 21:05:22.026008 32092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:22.023213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:43423 (local address 127.15.37.1:36237)
0810 21:05:22.023271 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:22.023273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:22.023413 (+ 140us) server_negotiation.cc:407] Connection header received
0810 21:05:22.023448 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:22.023449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:22.023462 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:22.023533 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:05:22.023724 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:22.024209 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:22.025263 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:22.025621 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:22.025680 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:22.025689 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:22.025888 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 21:05:22.025937 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 21:05:22.026017 32114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:22.023137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:36237 (local address 127.15.37.3:43423)
0810 21:05:22.023333 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:22.023342 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:22.023394 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:22.023546 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:22.023547 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:22.023549 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:05:22.023644 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:22.023645 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:22.024294 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:22.024295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:22.025129 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:22.025132 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:22.025715 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:22.025716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:22.025797 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:22.025800 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:05:22.025853 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 21:05:22.025886 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":1,"thread_start_us":105,"threads_started":1}
I20260810 21:05:22.026069 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:22.023188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:57427 (local address 127.15.37.2:44491)
0810 21:05:22.023247 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:22.023249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:22.023259 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:05:22.023290 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:22.023292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:22.023304 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:22.023373 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:05:22.023610 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:22.024139 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:22.025224 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:22.025683 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:22.025758 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:22.025769 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:22.025949 (+ 180us) server_negotiation.cc:299] Negotiation successful
0810 21:05:22.025989 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 21:05:22.026037 32069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:22.023081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:44491 (local address 127.15.37.3:57427)
0810 21:05:22.023148 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:22.023161 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:05:22.023212 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:05:22.023418 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:05:22.023419 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:05:22.023422 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:05:22.023508 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:22.023510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:22.024231 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:22.024232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:22.025115 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:05:22.025117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:05:22.025771 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:05:22.025772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:05:22.025858 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:22.025862 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:05:22.025923 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 21:05:22.025963 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":15}
I20260810 21:05:22.026434 31779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119c7afdc4864db09413d173de25af30" candidate_uuid: "154d9c25beba48da91e8307e12af871f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2203704b55e040a0b5a69564e352d95d" is_pre_election: true
I20260810 21:05:22.026544 31580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119c7afdc4864db09413d173de25af30" candidate_uuid: "154d9c25beba48da91e8307e12af871f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf232705556448e5b0fd0a37dca75e19" is_pre_election: true
I20260810 21:05:22.026626 31779 raft_consensus.cc:2454] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 154d9c25beba48da91e8307e12af871f in term 0.
I20260810 21:05:22.026693 31580 raft_consensus.cc:2454] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 154d9c25beba48da91e8307e12af871f in term 0.
I20260810 21:05:22.026876 31888 leader_election.cc:302] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 154d9c25beba48da91e8307e12af871f, 2203704b55e040a0b5a69564e352d95d; no voters:
I20260810 21:05:22.027067 32113 raft_consensus.cc:2781] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:05:22.027117 32113 raft_consensus.cc:482] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:05:22.027137 32113 raft_consensus.cc:3037] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:05:22.027981 32113 raft_consensus.cc:504] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2203704b55e040a0b5a69564e352d95d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 44491 } } peers { permanent_uuid: "bf232705556448e5b0fd0a37dca75e19" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36237 } } peers { permanent_uuid: "154d9c25beba48da91e8307e12af871f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39525 } }
I20260810 21:05:22.028142 32113 leader_election.cc:288] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [CANDIDATE]: Term 1 election: Requested vote from peers 2203704b55e040a0b5a69564e352d95d (127.15.37.2:44491), bf232705556448e5b0fd0a37dca75e19 (127.15.37.1:36237)
I20260810 21:05:22.028322 31580 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119c7afdc4864db09413d173de25af30" candidate_uuid: "154d9c25beba48da91e8307e12af871f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf232705556448e5b0fd0a37dca75e19"
I20260810 21:05:22.028362 31779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "119c7afdc4864db09413d173de25af30" candidate_uuid: "154d9c25beba48da91e8307e12af871f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2203704b55e040a0b5a69564e352d95d"
I20260810 21:05:22.028422 31779 raft_consensus.cc:3037] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:05:22.028411 31580 raft_consensus.cc:3037] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:05:22.029345 31779 raft_consensus.cc:2454] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 154d9c25beba48da91e8307e12af871f in term 1.
I20260810 21:05:22.029345 31580 raft_consensus.cc:2454] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 154d9c25beba48da91e8307e12af871f in term 1.
I20260810 21:05:22.029538 31888 leader_election.cc:302] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 154d9c25beba48da91e8307e12af871f, 2203704b55e040a0b5a69564e352d95d; no voters:
I20260810 21:05:22.029659 32113 raft_consensus.cc:2781] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:05:22.029800 32113 raft_consensus.cc:686] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [term 1 LEADER]: Becoming Leader. State: Replica: 154d9c25beba48da91e8307e12af871f, State: Running, Role: LEADER
I20260810 21:05:22.029906 32113 consensus_queue.cc:237] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2203704b55e040a0b5a69564e352d95d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 44491 } } peers { permanent_uuid: "bf232705556448e5b0fd0a37dca75e19" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36237 } } peers { permanent_uuid: "154d9c25beba48da91e8307e12af871f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39525 } }
I20260810 21:05:22.030857 31339 catalog_manager.cc:5495] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f reported cstate change: term changed from 0 to 1, leader changed from <none> to 154d9c25beba48da91e8307e12af871f (127.15.37.3). New cstate: current_term: 1 leader_uuid: "154d9c25beba48da91e8307e12af871f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2203704b55e040a0b5a69564e352d95d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 44491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf232705556448e5b0fd0a37dca75e19" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "154d9c25beba48da91e8307e12af871f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39525 } health_report { overall_health: HEALTHY } } }
I20260810 21:05:22.059424 32096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:22.056904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50160 (local address 127.15.37.3:39525)
0810 21:05:22.056969 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 21:05:22.056971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:05:22.056982 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:05:22.057029 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:05:22.057030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:05:22.057060 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:05:22.057141 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:05:22.057316 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:22.057793 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:22.058575 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:05:22.058774 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:05:22.058853 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:05:22.059036 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:05:22.059150 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:05:22.059244 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 21:05:22.059285 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 21:05:22.059307 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 21:05:22.061527 31580 raft_consensus.cc:1261] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19 [term 1 FOLLOWER]: Refusing update from remote peer 154d9c25beba48da91e8307e12af871f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:05:22.061554 31779 raft_consensus.cc:1261] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d [term 1 FOLLOWER]: Refusing update from remote peer 154d9c25beba48da91e8307e12af871f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:05:22.061916 32115 consensus_queue.cc:1035] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf232705556448e5b0fd0a37dca75e19" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:05:22.062065 32113 consensus_queue.cc:1035] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2203704b55e040a0b5a69564e352d95d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 44491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:05:22.064613 32118 mvcc.cc:205] Tried to move back new op lower bound from 7317077696760733696 to 7317077696635101184. Current Snapshot: MvccSnapshot[applied={T|T < 7317077696760733696}]
I20260810 21:05:22.064792 32124 mvcc.cc:205] Tried to move back new op lower bound from 7317077696760733696 to 7317077696635101184. Current Snapshot: MvccSnapshot[applied={T|T < 7317077696760733696}]
I20260810 21:05:22.065311 32119 mvcc.cc:205] Tried to move back new op lower bound from 7317077696760733696 to 7317077696635101184. Current Snapshot: MvccSnapshot[applied={T|T < 7317077696760733696 or (T in {7317077696760733696})}]
I20260810 21:05:22.066817 31338 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:05:22.066917 31338 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:05:22.067790 31338 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 92f02b39e9f44ce6ada2e2b1b4ea6780: Sending DeleteTablet for 3 replicas of tablet 119c7afdc4864db09413d173de25af30
I20260810 21:05:22.068157 31752 tablet_service.cc:1514] Processing DeleteTablet for tablet 119c7afdc4864db09413d173de25af30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:05:22 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:38812
I20260810 21:05:22.068194 31957 tablet_service.cc:1514] Processing DeleteTablet for tablet 119c7afdc4864db09413d173de25af30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:05:22 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:50156
I20260810 21:05:22.068406 31545 tablet_service.cc:1514] Processing DeleteTablet for tablet 119c7afdc4864db09413d173de25af30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:05:22 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:58810
I20260810 21:05:22.068518 32138 tablet_replica.cc:330] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f: stopping tablet replica
I20260810 21:05:22.068626 32138 raft_consensus.cc:2229] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:05:22.068655 32139 tablet_replica.cc:330] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19: stopping tablet replica
I20260810 21:05:22.068734 32138 raft_consensus.cc:2258] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:05:22.068894 32137 tablet_replica.cc:330] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d: stopping tablet replica
I20260810 21:05:22.068892 32139 raft_consensus.cc:2229] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:05:22.068981 32137 raft_consensus.cc:2229] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:05:22.069028 32139 raft_consensus.cc:2258] T 119c7afdc4864db09413d173de25af30 P bf232705556448e5b0fd0a37dca75e19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:05:22.069064 32137 raft_consensus.cc:2258] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:05:22.069169 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 31440
I20260810 21:05:22.072255 32138 ts_tablet_manager.cc:1905] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:05:22.074292 32138 ts_tablet_manager.cc:1918] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:05:22.074376 32138 log.cc:1196] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/119c7afdc4864db09413d173de25af30
I20260810 21:05:22.074736 32138 ts_tablet_manager.cc:1939] T 119c7afdc4864db09413d173de25af30 P 154d9c25beba48da91e8307e12af871f: Deleting consensus metadata
I20260810 21:05:22.075330 31315 catalog_manager.cc:4841] TS 154d9c25beba48da91e8307e12af871f (127.15.37.3:39525): tablet 119c7afdc4864db09413d173de25af30 (table test-table [id=d5d8d3b5698540e696517ab33fb178ae]) successfully deleted
I20260810 21:05:22.076771 32137 ts_tablet_manager.cc:1905] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:05:22.078538 32137 ts_tablet_manager.cc:1918] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:05:22.078639 32137 log.cc:1196] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/119c7afdc4864db09413d173de25af30
I20260810 21:05:22.078925 32137 ts_tablet_manager.cc:1939] T 119c7afdc4864db09413d173de25af30 P 2203704b55e040a0b5a69564e352d95d: Deleting consensus metadata
I20260810 21:05:22.079417 31316 catalog_manager.cc:4841] TS 2203704b55e040a0b5a69564e352d95d (127.15.37.2:44491): tablet 119c7afdc4864db09413d173de25af30 (table test-table [id=d5d8d3b5698540e696517ab33fb178ae]) successfully deleted
W20260810 21:05:22.082448 31310 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:36237 (error 108)
I20260810 21:05:22.083086 32089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:05:22.082932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:36237 (local address 127.0.0.1:58816)
0810 21:05:22.083001 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 21:05:22.083047 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:36237: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 21:05:22.083170 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 31656
W20260810 21:05:22.091329 31310 catalog_manager.cc:4584] TS bf232705556448e5b0fd0a37dca75e19 (127.15.37.1:36237): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 119c7afdc4864db09413d173de25af30: Network error: Client connection negotiation failed: client connection to 127.15.37.1:36237: connect: Connection refused (error 111)
I20260810 21:05:22.096087 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 31858
I20260810 21:05:22.105933 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 31285
2026-08-10T21:05:22Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2452 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:05:22 dist-test-slave-jq4t krb5kdc[32147](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:05:22 dist-test-slave-jq4t krb5kdc[32147](info): set up 2 sockets
Aug 10 21:05:22 dist-test-slave-jq4t krb5kdc[32147](info): commencing operation
krb5kdc: starting...
W20260810 21:05:23.391683 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:05:23 dist-test-slave-jq4t krb5kdc[32147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:05:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:05:23Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/rangeradmin_127.15.37.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/rangeradmin_127.15.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/rangerlookup_127.15.37.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/rangerlookup_127.15.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/HTTP_127.15.37.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/HTTP_127.15.37.20@KRBTEST.COM.keytab.
I20260810 21:05:23.583276 15508 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskEugCJs/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/postgres -l logfile start
2026-08-10 21:05:26.243 UTC [32197] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 21:05:26.244 UTC [32197] LOG: listening on IPv4 address "127.15.37.20", port 33115
2026-08-10 21:05:26.247 UTC [32197] LOG: listening on Unix socket "/tmp/.s.PGSQL.33115"
2026-08-10 21:05:26.279 UTC [32203] LOG: database system was shut down at 2026-08-10 21:05:24 UTC
2026-08-10 21:05:26.283 UTC [32197] LOG: database system is ready to accept connections
I20260810 21:05:27.458828 15508 mini_postgres.cc:96] Postgres bound to 33115
2026-08-10 21:05:27.467 UTC [32218] FATAL: database "slave" does not exist
127.15.37.20:33115 - accepting connections
I20260810 21:05:27.468883 15508 mini_ranger.cc:161] Starting Ranger...
I20260810 21:05:27.487010 15508 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 21:05:28.000867 15508 mini_ranger.cc:87] Created ranger Postgres database
I20260810 21:05:28.000972 15508 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-admin
2026-08-10 21:05:28,400 [I] DB FLAVOR :POSTGRES
2026-08-10 21:05:28,400 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 21:05:28,400 [I] Checking connection..
2026-08-10 21:05:28,401 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 21:05:28,697 [I] Checking connection passed.
2026-08-10 21:05:28,697 [I] --------- Verifying version history table ---------
2026-08-10 21:05:28,698 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 21:05:28,975 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 21:05:28,975 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 21:05:29,264 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 21:05:29,265 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 21:05:29,265 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 21:05:29.523 UTC [32326] WARNING: there is no transaction in progress
2026-08-10 21:05:29,533 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 21:05:29,534 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 21:05:29,797 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 21:05:29,798 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 21:05:29,798 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 21:05:30,052 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 21:05:30,328 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jq4t.c.gcp-upstream.internal','N') ;"
2026-08-10 21:05:30,597 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 21:05:30,856 [I] Table x_portal_user does not exist in database ranger
2026-08-10 21:05:30,856 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 21:05:31,137 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 21:05:31,137 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 21:05:31,416 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 21:05:31,672 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 21:05:31,672 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 21:05:32.741 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.758 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.776 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.794 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.811 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.833 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.901 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.909 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.924 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.936 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.946 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.963 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.973 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.982 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.990 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:32.998 UTC [32517] WARNING: there is no transaction in progress
2026-08-10 21:05:33,725 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 21:05:33,725 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 21:05:33,984 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 21:05:33,984 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 21:05:34,234 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 21:05:34,235 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 21:05:34,496 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 21:05:34,497 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 21:05:34,746 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 21:05:35,011 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jq4t.c.gcp-upstream.internal';"
2026-08-10 21:05:35,274 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 21:05:35,275 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 21:05:35,552 [I] DB_PATCHES have already been applied
I20260810 21:05:35.558881 15508 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-admin:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskEugCJs/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 21:05:35.558971 15508 mini_ranger.cc:193] Using host: 127.15.37.20
I20260810 21:05:35.563054 15508 mini_ranger.cc:227] Ranger admin URL: http://127.15.37.20:33929
Aug 10, 2026 9:05:35 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 9:05:35 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 9:05:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 9:05:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 9:05:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 9:05:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 9:05:36 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 21:05:36.937450 15508 mini_ranger.cc:160] Time spent starting Ranger: real 9.469s user 0.000s sys 0.012s
Aug 10, 2026 9:05:59 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 9:05:59 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 10, 2026 9:05:59 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 9:05:59 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 9:05:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 9:05:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 9:05:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 9:05:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 9:05:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 9:05:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 9:05:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 9:05:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 9:05:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 9:05:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 9:05:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 9:05:59 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 9:05:59 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 9:06:00 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 21:06:01.595786 15508 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/rangerkms_127.15.37.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/rangerkms_127.15.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.37.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.37.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.37.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/HTTP_127.15.37.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.37.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/HTTP_127.15.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 21:06:01 dist-test-slave-jq4t krb5kdc[32147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395961, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 21:06:01.713121 15508 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 21:06:01.727705 15508 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 21:06:02.752393 15508 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 21:06:02.752538 15508 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-kms
I20260810 21:06:02.752561 15508 mini_ranger_kms.cc:227] Using postgres at 127.15.37.20:33115
2026-08-10 21:06:03,413 [I] DB FLAVOR :POSTGRES
2026-08-10 21:06:03,413 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 21:06:03,413 [I] Checking connection
2026-08-10 21:06:03,413 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 21:06:03,766 [I] connection success
2026-08-10 21:06:03,767 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 21:06:03,767 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 21:06:03,767 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 21:06:04,039 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 21:06:04,039 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 21:06:04,039 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 21:06:04,039 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:33115/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 21:06:04,339 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 21:06:04.923475 15508 mini_ranger_kms.cc:310] Created kms service
I20260810 21:06:05.168243 15508 mini_ranger_kms.cc:326] Created kudu user
I20260810 21:06:05.222479 15508 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 21:06:05 dist-test-slave-jq4t krb5kdc[32147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395961, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:06:05.697255 15508 mini_ranger_kms.cc:384] Added ranger policy
I20260810 21:06:05.697404 15508 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-kms:/tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 21:06:05.697430 15508 mini_ranger_kms.cc:240] Using host: 127.15.37.20
I20260810 21:06:05.701648 15508 mini_ranger_kms.cc:276] Ranger KMS PID: 336
I20260810 21:06:05.701793 15508 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.37.20:40211
Aug 10, 2026 9:06:07 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 9:06:07 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 9:06:07 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 9:06:07 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 9:06:07 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 9:06:07 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 21:06:08 dist-test-slave-jq4t krb5kdc[32147](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786395968, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.37.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:06:08.740260 15508 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 7.027s user 0.022s sys 0.602s
I20260810 21:06:08.740417 15508 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 21:06:08.740562 15508 mini_ranger_kms.cc:401] 127.15.37.20:40211/kms/v1/keys
Aug 10 21:06:09 dist-test-slave-jq4t krb5kdc[32147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395968, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.37.20@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
Aug 10 21:06:09 dist-test-slave-jq4t krb5kdc[32147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395968, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.37.20@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
Aug 10 21:06:12 dist-test-slave-jq4t krb5kdc[32147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:06:12.433884 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:36957
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:40557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:36957
--ranger_config_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.37.20:40211/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:06:12.561769 427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:06:12.562011 427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:06:12.562036 427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:06:12.563262 427 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:06:12.563305 427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:06:12.563320 427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:06:12.563333 427 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:06:12.563345 427 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:06:12.565351 427 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:40557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.37.20:40211/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:36957
--ranger_config_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:36957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:06:12.565604 427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:06:12.565807 427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:06:12.572216 444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:06:12.572315 440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:06:12.572232 437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:06:12.572404 427 server_base.cc:1034] running on GCE node
I20260810 21:06:12.572717 427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:06:12.573104 427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:06:12.574280 427 hybrid_clock.cc:648] HybridClock initialized: now 1786395972574258 us; error 38 us; skew 500 ppm
Aug 10 21:06:12 dist-test-slave-jq4t krb5kdc[32147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395972, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:06:12.577122 427 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:06:12.577633 427 webserver.cc:460] Webserver started at http://127.15.37.62:41733/ using document root <none> and password file <none>
I20260810 21:06:12.577898 427 fs_manager.cc:359] Metadata directory not provided
I20260810 21:06:12.577960 427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:06:12.578125 427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 21:06:12 dist-test-slave-jq4t krb5kdc[32147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395972, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:06:12.646368 427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "03a2f4b8171a4755865a6ebbcafea1fe"
format_stamp: "Formatted at 2026-08-10 21:06:12 on dist-test-slave-jq4t"
server_key: "145130ae29538afb7dded4137d6ed853"
server_key_iv: "87fa2dd80a3f1f4f6926d4e0baf72ac8"
server_key_version: "kuduclusterkey@0"
I20260810 21:06:12.646943 427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "03a2f4b8171a4755865a6ebbcafea1fe"
format_stamp: "Formatted at 2026-08-10 21:06:12 on dist-test-slave-jq4t"
server_key: "145130ae29538afb7dded4137d6ed853"
server_key_iv: "87fa2dd80a3f1f4f6926d4e0baf72ac8"
server_key_version: "kuduclusterkey@0"
I20260810 21:06:12.649128 427 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260810 21:06:12.663753 454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:06:12.664146 427 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 21:06:12.664271 427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "03a2f4b8171a4755865a6ebbcafea1fe"
format_stamp: "Formatted at 2026-08-10 21:06:12 on dist-test-slave-jq4t"
server_key: "145130ae29538afb7dded4137d6ed853"
server_key_iv: "87fa2dd80a3f1f4f6926d4e0baf72ac8"
server_key_version: "kuduclusterkey@0"
I20260810 21:06:12.664389 427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:06:12.685945 427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:06:12.688416 427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:06:12.688683 427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:06:12.699579 427 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:36957
I20260810 21:06:12.699651 537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:36957 every 8 connection(s)
I20260810 21:06:12.700202 427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:06:12.701195 539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:06:12.703723 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 427
I20260810 21:06:12.703893 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:06:12.704119 15508 external_mini_cluster.cc:1428] Setting key 3e7b1a840379a0d157f4fe395744f279
I20260810 21:06:12.704613 539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe: Bootstrap starting.
I20260810 21:06:12.706305 539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe: Neither blocks nor log segments found. Creating new log.
I20260810 21:06:12.707238 539 log.cc:824] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe: Log is configured to *not* fsync() on all Append() calls
I20260810 21:06:12.708457 539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe: No bootstrap required, opened a new log
Aug 10 21:06:12 dist-test-slave-jq4t krb5kdc[32147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395972, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:06:12.712775 539 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03a2f4b8171a4755865a6ebbcafea1fe" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36957 } }
I20260810 21:06:12.713044 539 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:06:12.713116 539 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03a2f4b8171a4755865a6ebbcafea1fe, State: Initialized, Role: FOLLOWER
I20260810 21:06:12.713274 539 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03a2f4b8171a4755865a6ebbcafea1fe" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36957 } }
I20260810 21:06:12.713358 539 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:06:12.713392 539 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:06:12.713495 539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:06:12.714588 539 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03a2f4b8171a4755865a6ebbcafea1fe" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36957 } }
I20260810 21:06:12.714725 539 leader_election.cc:302] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03a2f4b8171a4755865a6ebbcafea1fe; no voters:
I20260810 21:06:12.714982 539 leader_election.cc:288] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:06:12.715140 551 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:06:12.715319 539 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:06:12.715402 551 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [term 1 LEADER]: Becoming Leader. State: Replica: 03a2f4b8171a4755865a6ebbcafea1fe, State: Running, Role: LEADER
I20260810 21:06:12.715586 551 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03a2f4b8171a4755865a6ebbcafea1fe" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36957 } }
I20260810 21:06:12.718575 539 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 21:06:12.718870 552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03a2f4b8171a4755865a6ebbcafea1fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03a2f4b8171a4755865a6ebbcafea1fe" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36957 } } }
I20260810 21:06:12.718991 552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [sys.catalog]: This master's current role is: LEADER
I20260810 21:06:12.719259 555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03a2f4b8171a4755865a6ebbcafea1fe. Latest consensus state: current_term: 1 leader_uuid: "03a2f4b8171a4755865a6ebbcafea1fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03a2f4b8171a4755865a6ebbcafea1fe" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36957 } } }
I20260810 21:06:12.719331 555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe [sys.catalog]: This master's current role is: LEADER
I20260810 21:06:12.719455 574 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:06:12.720366 574 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:06:12.720381 546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:12.704797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42974 (local address 127.15.37.62:36957)
0810 21:06:12.705178 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0810 21:06:12.705190 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 21:06:12.705275 (+ 85us) server_negotiation.cc:407] Connection header received
0810 21:06:12.706252 (+ 977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:06:12.706262 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:06:12.706321 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:06:12.706510 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:06:12.707446 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:12.708984 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:12.709923 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:12.710444 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:12.710586 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:12.713532 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:06:12.713538 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:06:12.713538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:06:12.713553 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:06:12.716461 (+ 2908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:06:12.717021 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:06:12.717025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:06:12.717025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:06:12.717154 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:06:12.717390 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:06:12.717391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:06:12.717392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:06:12.717801 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:06:12.719755 (+ 1954us) server_negotiation.cc:1035] Waiting for connection context
0810 21:06:12.719864 (+ 109us) server_negotiation.cc:299] Negotiation successful
0810 21:06:12.720035 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":190,"threads_started":1}
I20260810 21:06:12.736191 574 catalog_manager.cc:1347] Generated new cluster ID: b80ff164eb02468789b5e077b8e32db3
I20260810 21:06:12.736372 574 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:06:12.744680 574 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:06:12.746201 574 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:06:12.750074 574 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe: Generated new TSK 0
I20260810 21:06:12.750357 574 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:06:13.799865 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.37.20:40211/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36957
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:40557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:06:13.961699 620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:06:13.961946 620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:06:13.961977 620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:06:13.963402 620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:06:13.963459 620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:06:13.963490 620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:06:13.966333 620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:40557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.37.20:40211/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:06:13.966655 620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:06:13.967024 620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:06:13.976343 629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:06:13.976550 628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:06:13.976871 631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:06:13.977106 620 server_base.cc:1034] running on GCE node
I20260810 21:06:13.977439 620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:06:13.977837 620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:06:13.979229 620 hybrid_clock.cc:648] HybridClock initialized: now 1786395973979204 us; error 42 us; skew 500 ppm
Aug 10 21:06:13 dist-test-slave-jq4t krb5kdc[32147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395973, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:06:13.984584 620 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:06:13.985440 620 webserver.cc:460] Webserver started at http://127.15.37.1:32873/ using document root <none> and password file <none>
I20260810 21:06:13.985780 620 fs_manager.cc:359] Metadata directory not provided
I20260810 21:06:13.985857 620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:06:13.986039 620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 21:06:13 dist-test-slave-jq4t krb5kdc[32147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395973, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:06:14.009310 620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "4d41adee2e884578afe8c0b0b804471a"
format_stamp: "Formatted at 2026-08-10 21:06:14 on dist-test-slave-jq4t"
server_key: "b28f9422a14a373f7fc5d78a4b10b385"
server_key_iv: "02df9d6a601c4479b53ae4dd63aaf963"
server_key_version: "kuduclusterkey@0"
I20260810 21:06:14.009900 620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "4d41adee2e884578afe8c0b0b804471a"
format_stamp: "Formatted at 2026-08-10 21:06:14 on dist-test-slave-jq4t"
server_key: "b28f9422a14a373f7fc5d78a4b10b385"
server_key_iv: "02df9d6a601c4479b53ae4dd63aaf963"
server_key_version: "kuduclusterkey@0"
I20260810 21:06:14.012578 620 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260810 21:06:14.032678 645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:06:14.032951 620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:06:14.033068 620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "4d41adee2e884578afe8c0b0b804471a"
format_stamp: "Formatted at 2026-08-10 21:06:14 on dist-test-slave-jq4t"
server_key: "b28f9422a14a373f7fc5d78a4b10b385"
server_key_iv: "02df9d6a601c4479b53ae4dd63aaf963"
server_key_version: "kuduclusterkey@0"
I20260810 21:06:14.033203 620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:06:14.050648 620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:06:14.053261 620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:06:14.053535 620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:06:14.053902 620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:06:14.054383 620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:06:14.054440 620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:06:14.054504 620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:06:14.054548 620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:06:14.082427 620 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:37367
I20260810 21:06:14.082620 835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:37367 every 8 connection(s)
I20260810 21:06:14.083171 620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:06:14.085429 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 620
I20260810 21:06:14.085536 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:06:14.085727 15508 external_mini_cluster.cc:1428] Setting key 98a5be088b601d1555effda0613a99af
Aug 10 21:06:14 dist-test-slave-jq4t krb5kdc[32147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395973, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
I20260810 21:06:14.101188 848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:14.084872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:36259 (local address 127.15.37.62:36957)
0810 21:06:14.087330 (+ 2458us) server_negotiation.cc:206] Beginning negotiation
0810 21:06:14.087332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:06:14.087342 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:06:14.087369 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:06:14.087370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:06:14.087384 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:06:14.087634 (+ 250us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:06:14.088995 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.090108 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.092228 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.092580 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.092661 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:14.096529 (+ 3868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:06:14.096531 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:06:14.096531 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:06:14.096541 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:06:14.098944 (+ 2403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:06:14.099580 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:06:14.099582 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:06:14.099582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:06:14.099672 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:06:14.100062 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:06:14.100063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:06:14.100063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:06:14.100248 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:06:14.100350 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 21:06:14.100909 (+ 559us) server_negotiation.cc:299] Negotiation successful
0810 21:06:14.101044 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2430,"thread_start_us":164,"threads_started":1}
I20260810 21:06:14.101346 841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:14.084341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36957 (local address 127.15.37.1:36259)
0810 21:06:14.084839 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0810 21:06:14.084895 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 21:06:14.086466 (+ 1571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:06:14.087755 (+ 1289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:06:14.087760 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:06:14.088335 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:06:14.088870 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:14.088877 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.090247 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.090248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:14.092116 (+ 1868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:14.092120 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.092686 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.092687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:14.092978 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:14.093873 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:06:14.093885 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:06:14.096368 (+ 2483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:06:14.099078 (+ 2710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:06:14.099090 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:06:14.099093 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:06:14.099469 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:06:14.099787 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:06:14.099788 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:06:14.099789 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:06:14.099963 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:06:14.100347 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:06:14.100355 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:06:14.100722 (+ 367us) client_negotiation.cc:769] Sending connection context
0810 21:06:14.100864 (+ 142us) client_negotiation.cc:240] Negotiation successful
0810 21:06:14.101099 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":327,"threads_started":1}
I20260810 21:06:14.102293 838 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36957
I20260810 21:06:14.102427 838 heartbeater.cc:464] Registering TS with master...
I20260810 21:06:14.102658 838 heartbeater.cc:511] Master 127.15.37.62:36957 requested a full tablet report, sending...
I20260810 21:06:14.103386 481 ts_manager.cc:194] Registered new tserver with Master: 4d41adee2e884578afe8c0b0b804471a (127.15.37.1:37367)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
I20260810 21:06:14.104574 481 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:36259
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:06:14.128309 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.37.20:40211/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36957
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:40557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:06:14.282099 852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:06:14.282354 852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:06:14.282401 852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:06:14.283984 852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:06:14.284065 852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:06:14.284113 852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:06:14.286769 852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:40557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.37.20:40211/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:06:14.287117 852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:06:14.287436 852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:06:14.299296 868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:06:14.300874 865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:06:14.301216 852 server_base.cc:1034] running on GCE node
W20260810 21:06:14.302364 866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:06:14.302793 852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:06:14.303210 852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:06:14.306586 852 hybrid_clock.cc:648] HybridClock initialized: now 1786395974306566 us; error 40 us; skew 500 ppm
Aug 10 21:06:14 dist-test-slave-jq4t krb5kdc[32147](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786395974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 10 21:06:14 dist-test-slave-jq4t krb5kdc[32147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:06:14.311800 852 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:06:14.313000 852 webserver.cc:460] Webserver started at http://127.15.37.2:34295/ using document root <none> and password file <none>
I20260810 21:06:14.313438 852 fs_manager.cc:359] Metadata directory not provided
I20260810 21:06:14.313583 852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:06:14.313807 852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 21:06:14 dist-test-slave-jq4t krb5kdc[32147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:06:14.332052 852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb"
format_stamp: "Formatted at 2026-08-10 21:06:14 on dist-test-slave-jq4t"
server_key: "5b0bea164d6ce98235b4b31052564b8a"
server_key_iv: "f97d2d3b2079cfa488a89ff4fbf22873"
server_key_version: "kuduclusterkey@0"
I20260810 21:06:14.332669 852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb"
format_stamp: "Formatted at 2026-08-10 21:06:14 on dist-test-slave-jq4t"
server_key: "5b0bea164d6ce98235b4b31052564b8a"
server_key_iv: "f97d2d3b2079cfa488a89ff4fbf22873"
server_key_version: "kuduclusterkey@0"
I20260810 21:06:14.335096 852 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 21:06:14.356705 881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:06:14.357046 852 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.001s
I20260810 21:06:14.357209 852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb"
format_stamp: "Formatted at 2026-08-10 21:06:14 on dist-test-slave-jq4t"
server_key: "5b0bea164d6ce98235b4b31052564b8a"
server_key_iv: "f97d2d3b2079cfa488a89ff4fbf22873"
server_key_version: "kuduclusterkey@0"
I20260810 21:06:14.357399 852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:06:14.373904 852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:06:14.377067 852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:06:14.377296 852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:06:14.377647 852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:06:14.378322 852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:06:14.378378 852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:06:14.378413 852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:06:14.378479 852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:06:14.402482 852 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:45301
I20260810 21:06:14.403223 852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:06:14.404038 1066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:45301 every 8 connection(s)
I20260810 21:06:14.409708 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 852
I20260810 21:06:14.409833 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:06:14.410049 15508 external_mini_cluster.cc:1428] Setting key 7121c03c6746c3a81f9e993a787c61a0
Aug 10 21:06:14 dist-test-slave-jq4t krb5kdc[32147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:06:14.419790 848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:14.405947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:46809 (local address 127.15.37.62:36957)
0810 21:06:14.406003 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 21:06:14.406005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:06:14.406986 (+ 981us) server_negotiation.cc:407] Connection header received
0810 21:06:14.407926 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:06:14.407928 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:06:14.407943 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:06:14.407988 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:06:14.409217 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.410030 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.411945 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.412259 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.412311 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:14.415964 (+ 3653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:06:14.415966 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:06:14.415967 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:06:14.415976 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:06:14.417853 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:06:14.418453 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:06:14.418455 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:06:14.418455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:06:14.418531 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:06:14.418855 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:06:14.418856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:06:14.418856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:06:14.419029 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:06:14.419076 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 21:06:14.419566 (+ 490us) server_negotiation.cc:299] Negotiation successful
0810 21:06:14.419679 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 21:06:14.420745 1071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:14.405429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36957 (local address 127.15.37.2:46809)
0810 21:06:14.406747 (+ 1318us) negotiation.cc:107] Waiting for socket to connect
0810 21:06:14.406798 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 21:06:14.407783 (+ 985us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:06:14.408194 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:06:14.408198 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:06:14.408653 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:06:14.409096 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:14.409103 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.410157 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.410158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:14.411832 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:14.411836 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.412420 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.412421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:14.412707 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:14.413560 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:06:14.413572 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:06:14.415808 (+ 2236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:06:14.417986 (+ 2178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:06:14.417994 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:06:14.417998 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:06:14.418353 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:06:14.418611 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:06:14.418612 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:06:14.418612 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:06:14.418769 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:06:14.419127 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:06:14.419135 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:06:14.419385 (+ 250us) client_negotiation.cc:769] Sending connection context
0810 21:06:14.420225 (+ 840us) client_negotiation.cc:240] Negotiation successful
0810 21:06:14.420430 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1249,"thread_start_us":283,"threads_started":1}
I20260810 21:06:14.421754 1067 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36957
I20260810 21:06:14.421881 1067 heartbeater.cc:464] Registering TS with master...
I20260810 21:06:14.422119 1067 heartbeater.cc:511] Master 127.15.37.62:36957 requested a full tablet report, sending...
I20260810 21:06:14.422657 481 ts_manager.cc:194] Registered new tserver with Master: aae3c5277f7546bbba7ec56bfc9bc1eb (127.15.37.2:45301)
I20260810 21:06:14.423199 481 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:46809
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:06:14.473069 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.37.20:40211/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36957
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:40557
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:06:14.627655 1080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:06:14.628042 1080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:06:14.628093 1080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:06:14.630440 1080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:06:14.630524 1080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:06:14.630575 1080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:06:14.633781 1080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:40557
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.37.20:40211/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36957
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:06:14.634143 1080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:06:14.634532 1080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:06:14.643349 1087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:06:14.643602 1080 server_base.cc:1034] running on GCE node
W20260810 21:06:14.644676 1085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:06:14.645011 1090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:06:14.645555 1080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:06:14.645922 1080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:06:14.649255 1080 hybrid_clock.cc:648] HybridClock initialized: now 1786395974649208 us; error 72 us; skew 500 ppm
Aug 10 21:06:14 dist-test-slave-jq4t krb5kdc[32147](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:06:14.657522 1080 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:06:14.658444 1080 webserver.cc:460] Webserver started at http://127.15.37.3:36527/ using document root <none> and password file <none>
I20260810 21:06:14.658784 1080 fs_manager.cc:359] Metadata directory not provided
I20260810 21:06:14.658887 1080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:06:14.659224 1080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 21:06:14 dist-test-slave-jq4t krb5kdc[32147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:06:14.682655 1080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "f0a2c801b1424bf59bf22a523f7d5cbe"
format_stamp: "Formatted at 2026-08-10 21:06:14 on dist-test-slave-jq4t"
server_key: "41bc0538c1ebbbd8e6cb13081e7ca935"
server_key_iv: "f9da6aa97179422120bb372b464473c1"
server_key_version: "kuduclusterkey@0"
I20260810 21:06:14.683262 1080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "f0a2c801b1424bf59bf22a523f7d5cbe"
format_stamp: "Formatted at 2026-08-10 21:06:14 on dist-test-slave-jq4t"
server_key: "41bc0538c1ebbbd8e6cb13081e7ca935"
server_key_iv: "f9da6aa97179422120bb372b464473c1"
server_key_version: "kuduclusterkey@0"
I20260810 21:06:14.687877 1080 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260810 21:06:14.704710 1100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:06:14.705035 1080 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:06:14.705179 1080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "f0a2c801b1424bf59bf22a523f7d5cbe"
format_stamp: "Formatted at 2026-08-10 21:06:14 on dist-test-slave-jq4t"
server_key: "41bc0538c1ebbbd8e6cb13081e7ca935"
server_key_iv: "f9da6aa97179422120bb372b464473c1"
server_key_version: "kuduclusterkey@0"
I20260810 21:06:14.705291 1080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:06:14.719129 1080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:06:14.721565 1080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:06:14.721812 1080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:06:14.722180 1080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:06:14.722741 1080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:06:14.722803 1080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:06:14.722846 1080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:06:14.722874 1080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:06:14.744599 1080 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:42939
I20260810 21:06:14.744755 1286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:42939 every 8 connection(s)
I20260810 21:06:14.745216 1080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:06:14.749234 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 1080
I20260810 21:06:14.749387 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:06:14.749567 15508 external_mini_cluster.cc:1428] Setting key 6b962f12ebc191f2cce139223456831f
Aug 10 21:06:14 dist-test-slave-jq4t krb5kdc[32147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:06:14.762279 848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:14.746502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:50833 (local address 127.15.37.62:36957)
0810 21:06:14.746608 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 21:06:14.746610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:06:14.747484 (+ 874us) server_negotiation.cc:407] Connection header received
0810 21:06:14.749119 (+ 1635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:06:14.749120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:06:14.749136 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:06:14.749187 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:06:14.750960 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.751471 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.754023 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.754227 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.754290 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:14.758278 (+ 3988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:06:14.758280 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:06:14.758280 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:06:14.758289 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:06:14.759822 (+ 1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:06:14.760707 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:06:14.760713 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:06:14.760714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:06:14.760777 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:06:14.761275 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:06:14.761277 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:06:14.761277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:06:14.761486 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:06:14.761579 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 21:06:14.762081 (+ 502us) server_negotiation.cc:299] Negotiation successful
0810 21:06:14.762181 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 21:06:14.762641 1290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:14.746500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36957 (local address 127.15.37.3:50833)
0810 21:06:14.747009 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0810 21:06:14.747101 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0810 21:06:14.748857 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:06:14.749344 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:06:14.749362 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:06:14.750002 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:06:14.750785 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:14.750793 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.751585 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.751586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:14.753812 (+ 2226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:14.753817 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.754349 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.754350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:14.754609 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:14.755682 (+ 1073us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:06:14.755704 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:06:14.758089 (+ 2385us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:06:14.759952 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:06:14.759972 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:06:14.759977 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:06:14.760581 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:06:14.760859 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:06:14.760860 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:06:14.760861 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:06:14.761074 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:06:14.761652 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:06:14.761666 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:06:14.761906 (+ 240us) client_negotiation.cc:769] Sending connection context
0810 21:06:14.762042 (+ 136us) client_negotiation.cc:240] Negotiation successful
0810 21:06:14.762228 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":309,"threads_started":1}
I20260810 21:06:14.763410 1287 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36957
I20260810 21:06:14.763581 1287 heartbeater.cc:464] Registering TS with master...
I20260810 21:06:14.763820 1287 heartbeater.cc:511] Master 127.15.37.62:36957 requested a full tablet report, sending...
I20260810 21:06:14.765028 481 ts_manager.cc:194] Registered new tserver with Master: f0a2c801b1424bf59bf22a523f7d5cbe (127.15.37.3:42939)
I20260810 21:06:14.765568 481 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:50833
I20260810 21:06:14.772764 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:06:14.784158 848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:14.776611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42980 (local address 127.15.37.62:36957)
0810 21:06:14.776667 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 21:06:14.776669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:06:14.777034 (+ 365us) server_negotiation.cc:407] Connection header received
0810 21:06:14.777111 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:06:14.777112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:06:14.777126 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:06:14.777173 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:06:14.777828 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.778350 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.779235 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.779446 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.779529 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:14.781207 (+ 1678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:06:14.781209 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:06:14.781209 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:06:14.781218 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:06:14.782870 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:06:14.783271 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:06:14.783273 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:06:14.783273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:06:14.783341 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:06:14.783575 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:06:14.783576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:06:14.783576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:06:14.783703 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:06:14.783814 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 21:06:14.783953 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 21:06:14.784044 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 21:06:14.786803 481 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:06:14.789839 481 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:06:14.801102 1320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:14.794537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:45301 (local address 127.0.0.1:42112)
0810 21:06:14.795210 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0810 21:06:14.795255 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 21:06:14.795483 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:06:14.796524 (+ 1041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:06:14.796528 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:06:14.796531 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:06:14.796610 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:14.796612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.798113 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.798114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:14.799520 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:14.799523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.800786 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.800787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:14.800881 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:14.800899 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 21:06:14.800953 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 21:06:14.801007 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":196,"threads_started":1}
I20260810 21:06:14.802021 1323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:14.795666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42112 (local address 127.15.37.2:45301)
0810 21:06:14.796058 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0810 21:06:14.796062 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:06:14.796074 (+ 12us) server_negotiation.cc:407] Connection header received
0810 21:06:14.796125 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:06:14.796127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:06:14.796144 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:06:14.796373 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:06:14.796703 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.798005 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.799691 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.800674 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.801609 (+ 935us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:14.801793 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0810 21:06:14.801825 (+ 32us) server_negotiation.cc:299] Negotiation successful
0810 21:06:14.801873 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":258,"threads_started":1}
I20260810 21:06:14.802825 940 tablet_service.cc:1467] Processing CreateTablet for tablet da659b54400246da908ae76b32005fec (DEFAULT_TABLE table=test-table [id=3f736cb9c43d4a44bb5a96b823fbd530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:06:14.803237 940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da659b54400246da908ae76b32005fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:06:14.805837 1322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:14.794538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:37367 (local address 127.0.0.1:46962)
0810 21:06:14.796800 (+ 2262us) negotiation.cc:107] Waiting for socket to connect
0810 21:06:14.796813 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:06:14.797007 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:06:14.797481 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:06:14.797482 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:06:14.797485 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:06:14.797532 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:14.797534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.799455 (+ 1921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.799456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:14.804262 (+ 4806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:14.804265 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.805548 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.805549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:14.805617 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:14.805623 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 21:06:14.805679 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 21:06:14.805728 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2221,"thread_start_us":228,"threads_started":1}
I20260810 21:06:14.806255 1321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:14.794980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46962 (local address 127.15.37.1:37367)
0810 21:06:14.795641 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0810 21:06:14.795647 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:06:14.796970 (+ 1323us) server_negotiation.cc:407] Connection header received
0810 21:06:14.797102 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:06:14.797105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:06:14.797123 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:06:14.797345 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:06:14.797610 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.799140 (+ 1530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.804362 (+ 5222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.805318 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.805399 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:14.805505 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 21:06:14.806128 (+ 623us) server_negotiation.cc:299] Negotiation successful
0810 21:06:14.806181 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":60,"threads_started":1}
I20260810 21:06:14.807312 715 tablet_service.cc:1467] Processing CreateTablet for tablet da659b54400246da908ae76b32005fec (DEFAULT_TABLE table=test-table [id=3f736cb9c43d4a44bb5a96b823fbd530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:06:14.807724 715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da659b54400246da908ae76b32005fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:06:14.813690 1328 tablet_bootstrap.cc:492] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a: Bootstrap starting.
I20260810 21:06:14.814451 1319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:14.794920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:42939 (local address 127.0.0.1:33268)
0810 21:06:14.800296 (+ 5376us) negotiation.cc:107] Waiting for socket to connect
0810 21:06:14.800309 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:06:14.800549 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:06:14.801318 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:06:14.801319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:06:14.801321 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:06:14.801362 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:14.801364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.802669 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.802670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:14.804081 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:14.804084 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.814177 (+ 10093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.814178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:14.814264 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:14.814273 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 21:06:14.814311 (+ 38us) client_negotiation.cc:240] Negotiation successful
0810 21:06:14.814366 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5349,"thread_start_us":301,"threads_started":1}
I20260810 21:06:14.815150 1328 tablet_bootstrap.cc:654] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a: Neither blocks nor log segments found. Creating new log.
I20260810 21:06:14.815477 1325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:14.796022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33268 (local address 127.15.37.3:42939)
0810 21:06:14.799404 (+ 3382us) server_negotiation.cc:206] Beginning negotiation
0810 21:06:14.799409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:06:14.800937 (+ 1528us) server_negotiation.cc:407] Connection header received
0810 21:06:14.801007 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:06:14.801010 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:06:14.801030 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:06:14.801203 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:06:14.801442 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.802562 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.812806 (+ 10244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:14.814010 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:14.815063 (+ 1053us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:14.815260 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0810 21:06:14.815301 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 21:06:14.815352 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3321,"thread_start_us":242,"threads_started":1}
I20260810 21:06:14.816035 1328 log.cc:824] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a: Log is configured to *not* fsync() on all Append() calls
I20260810 21:06:14.816522 1177 tablet_service.cc:1467] Processing CreateTablet for tablet da659b54400246da908ae76b32005fec (DEFAULT_TABLE table=test-table [id=3f736cb9c43d4a44bb5a96b823fbd530]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:06:14.817028 1177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da659b54400246da908ae76b32005fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:06:14.817719 1328 tablet_bootstrap.cc:492] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a: No bootstrap required, opened a new log
I20260810 21:06:14.817790 1328 ts_tablet_manager.cc:1397] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 21:06:14.822175 1330 tablet_bootstrap.cc:492] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe: Bootstrap starting.
I20260810 21:06:14.821967 1328 raft_consensus.cc:348] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 45301 } } peers { permanent_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42939 } } peers { permanent_uuid: "4d41adee2e884578afe8c0b0b804471a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37367 } }
I20260810 21:06:14.822629 1328 raft_consensus.cc:374] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:06:14.822680 1328 raft_consensus.cc:729] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d41adee2e884578afe8c0b0b804471a, State: Initialized, Role: FOLLOWER
I20260810 21:06:14.822801 1328 consensus_queue.cc:260] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 45301 } } peers { permanent_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42939 } } peers { permanent_uuid: "4d41adee2e884578afe8c0b0b804471a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37367 } }
I20260810 21:06:14.823218 1328 ts_tablet_manager.cc:1428] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260810 21:06:14.823362 838 heartbeater.cc:503] Master 127.15.37.62:36957 was elected leader, sending a full tablet report...
I20260810 21:06:14.824277 1330 tablet_bootstrap.cc:654] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe: Neither blocks nor log segments found. Creating new log.
I20260810 21:06:14.825354 1330 log.cc:824] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe: Log is configured to *not* fsync() on all Append() calls
I20260810 21:06:14.825881 1326 tablet_bootstrap.cc:492] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb: Bootstrap starting.
I20260810 21:06:14.827348 1326 tablet_bootstrap.cc:654] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb: Neither blocks nor log segments found. Creating new log.
I20260810 21:06:14.827965 1330 tablet_bootstrap.cc:492] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe: No bootstrap required, opened a new log
I20260810 21:06:14.828063 1330 ts_tablet_manager.cc:1397] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s
I20260810 21:06:14.831712 1330 raft_consensus.cc:348] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 45301 } } peers { permanent_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42939 } } peers { permanent_uuid: "4d41adee2e884578afe8c0b0b804471a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37367 } }
I20260810 21:06:14.831928 1330 raft_consensus.cc:374] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:06:14.832705 1330 raft_consensus.cc:729] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a2c801b1424bf59bf22a523f7d5cbe, State: Initialized, Role: FOLLOWER
I20260810 21:06:14.833004 1330 consensus_queue.cc:260] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 45301 } } peers { permanent_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42939 } } peers { permanent_uuid: "4d41adee2e884578afe8c0b0b804471a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37367 } }
I20260810 21:06:14.833061 1326 log.cc:824] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb: Log is configured to *not* fsync() on all Append() calls
I20260810 21:06:14.833552 1330 ts_tablet_manager.cc:1428] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260810 21:06:14.833750 1287 heartbeater.cc:503] Master 127.15.37.62:36957 was elected leader, sending a full tablet report...
I20260810 21:06:14.834254 1326 tablet_bootstrap.cc:492] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb: No bootstrap required, opened a new log
I20260810 21:06:14.834345 1326 ts_tablet_manager.cc:1397] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20260810 21:06:14.838604 1326 raft_consensus.cc:348] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 45301 } } peers { permanent_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42939 } } peers { permanent_uuid: "4d41adee2e884578afe8c0b0b804471a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37367 } }
I20260810 21:06:14.838904 1326 raft_consensus.cc:374] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:06:14.838968 1326 raft_consensus.cc:729] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aae3c5277f7546bbba7ec56bfc9bc1eb, State: Initialized, Role: FOLLOWER
I20260810 21:06:14.839109 1326 consensus_queue.cc:260] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 45301 } } peers { permanent_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42939 } } peers { permanent_uuid: "4d41adee2e884578afe8c0b0b804471a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37367 } }
I20260810 21:06:14.839485 1326 ts_tablet_manager.cc:1428] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260810 21:06:14.839545 1067 heartbeater.cc:503] Master 127.15.37.62:36957 was elected leader, sending a full tablet report...
W20260810 21:06:14.840603 840 tablet.cc:2369] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:06:14.906658 1070 tablet.cc:2369] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 21:06:14 dist-test-slave-jq4t krb5kdc[32147](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395974, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
W20260810 21:06:14.996160 1289 tablet.cc:2369] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:06:15.129500 1341 raft_consensus.cc:482] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:06:15.129706 1341 raft_consensus.cc:504] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 45301 } } peers { permanent_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42939 } } peers { permanent_uuid: "4d41adee2e884578afe8c0b0b804471a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37367 } }
I20260810 21:06:15.130259 1341 leader_election.cc:288] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aae3c5277f7546bbba7ec56bfc9bc1eb (127.15.37.2:45301), 4d41adee2e884578afe8c0b0b804471a (127.15.37.1:37367)
I20260810 21:06:15.135213 1290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:15.130450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:37367 (local address 127.15.37.3:54473)
0810 21:06:15.130672 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0810 21:06:15.130686 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:06:15.130744 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:06:15.131206 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:06:15.131207 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:06:15.131209 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:06:15.131419 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:15.131421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:15.132431 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:15.132432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:15.133832 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:15.133835 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:15.134732 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:15.134732 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:15.134857 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:15.134861 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:06:15.134925 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 21:06:15.135003 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":15}
I20260810 21:06:15.135187 1323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:15.130922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:48699 (local address 127.15.37.2:45301)
0810 21:06:15.130972 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 21:06:15.130974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:06:15.131228 (+ 254us) server_negotiation.cc:407] Connection header received
0810 21:06:15.131372 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:06:15.131374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:06:15.131398 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:06:15.131431 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:06:15.131798 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:15.132522 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:15.134106 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:15.134639 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:15.134684 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:15.134696 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 21:06:15.135050 (+ 354us) server_negotiation.cc:299] Negotiation successful
0810 21:06:15.135096 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 21:06:15.135591 1345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:15.130534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:45301 (local address 127.15.37.3:48699)
0810 21:06:15.131162 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0810 21:06:15.131174 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:06:15.131253 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:06:15.131506 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:06:15.131507 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:06:15.131509 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:06:15.131693 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:15.131694 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:15.132610 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:15.132611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:15.134008 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:06:15.134011 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:06:15.134752 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:06:15.134753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:06:15.134949 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:15.134953 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:06:15.135353 (+ 400us) client_negotiation.cc:240] Negotiation successful
0810 21:06:15.135412 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":164,"threads_started":1}
I20260810 21:06:15.135946 1321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:15.130854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:54473 (local address 127.15.37.1:37367)
0810 21:06:15.130942 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 21:06:15.130944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:06:15.130966 (+ 22us) server_negotiation.cc:407] Connection header received
0810 21:06:15.130999 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:06:15.131000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:06:15.131013 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:06:15.131072 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:06:15.131521 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:15.132335 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:15.134035 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:15.134618 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:15.134687 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:15.134696 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 21:06:15.135822 (+ 1126us) server_negotiation.cc:299] Negotiation successful
0810 21:06:15.135875 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260810 21:06:15.136102 992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da659b54400246da908ae76b32005fec" candidate_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb" is_pre_election: true
I20260810 21:06:15.136257 757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da659b54400246da908ae76b32005fec" candidate_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d41adee2e884578afe8c0b0b804471a" is_pre_election: true
I20260810 21:06:15.136300 992 raft_consensus.cc:2454] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0a2c801b1424bf59bf22a523f7d5cbe in term 0.
I20260810 21:06:15.136379 757 raft_consensus.cc:2454] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0a2c801b1424bf59bf22a523f7d5cbe in term 0.
I20260810 21:06:15.136613 1107 leader_election.cc:302] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aae3c5277f7546bbba7ec56bfc9bc1eb, f0a2c801b1424bf59bf22a523f7d5cbe; no voters:
I20260810 21:06:15.136771 1341 raft_consensus.cc:2781] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:06:15.136819 1341 raft_consensus.cc:482] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:06:15.136847 1341 raft_consensus.cc:3037] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:06:15.138170 1341 raft_consensus.cc:504] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 45301 } } peers { permanent_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42939 } } peers { permanent_uuid: "4d41adee2e884578afe8c0b0b804471a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37367 } }
I20260810 21:06:15.138342 1341 leader_election.cc:288] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [CANDIDATE]: Term 1 election: Requested vote from peers aae3c5277f7546bbba7ec56bfc9bc1eb (127.15.37.2:45301), 4d41adee2e884578afe8c0b0b804471a (127.15.37.1:37367)
I20260810 21:06:15.138530 992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da659b54400246da908ae76b32005fec" candidate_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb"
I20260810 21:06:15.138546 757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da659b54400246da908ae76b32005fec" candidate_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d41adee2e884578afe8c0b0b804471a"
I20260810 21:06:15.138621 992 raft_consensus.cc:3037] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:06:15.138636 757 raft_consensus.cc:3037] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:06:15.139727 757 raft_consensus.cc:2454] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a2c801b1424bf59bf22a523f7d5cbe in term 1.
I20260810 21:06:15.139788 992 raft_consensus.cc:2454] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a2c801b1424bf59bf22a523f7d5cbe in term 1.
I20260810 21:06:15.139973 1107 leader_election.cc:302] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aae3c5277f7546bbba7ec56bfc9bc1eb, f0a2c801b1424bf59bf22a523f7d5cbe; no voters:
I20260810 21:06:15.140095 1341 raft_consensus.cc:2781] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:06:15.140302 1341 raft_consensus.cc:686] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [term 1 LEADER]: Becoming Leader. State: Replica: f0a2c801b1424bf59bf22a523f7d5cbe, State: Running, Role: LEADER
I20260810 21:06:15.140421 1341 consensus_queue.cc:237] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 45301 } } peers { permanent_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42939 } } peers { permanent_uuid: "4d41adee2e884578afe8c0b0b804471a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37367 } }
I20260810 21:06:15.141621 481 catalog_manager.cc:5495] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe reported cstate change: term changed from 0 to 1, leader changed from <none> to f0a2c801b1424bf59bf22a523f7d5cbe (127.15.37.3). New cstate: current_term: 1 leader_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 45301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a2c801b1424bf59bf22a523f7d5cbe" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d41adee2e884578afe8c0b0b804471a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37367 } health_report { overall_health: UNKNOWN } } }
I20260810 21:06:15.159207 1325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:15.156444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33270 (local address 127.15.37.3:42939)
0810 21:06:15.156538 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 21:06:15.156539 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:06:15.156550 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:06:15.156650 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:06:15.156651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:06:15.156670 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:06:15.156761 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:06:15.156919 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:15.157520 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:15.158298 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:06:15.158521 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:06:15.158615 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:06:15.158841 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:06:15.158971 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:06:15.159069 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 21:06:15.159090 (+ 21us) server_negotiation.cc:299] Negotiation successful
0810 21:06:15.159110 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 21:06:15.161716 757 raft_consensus.cc:1261] T da659b54400246da908ae76b32005fec P 4d41adee2e884578afe8c0b0b804471a [term 1 FOLLOWER]: Refusing update from remote peer f0a2c801b1424bf59bf22a523f7d5cbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:06:15.161873 992 raft_consensus.cc:1261] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb [term 1 FOLLOWER]: Refusing update from remote peer f0a2c801b1424bf59bf22a523f7d5cbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:06:15.162195 1341 consensus_queue.cc:1035] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "aae3c5277f7546bbba7ec56bfc9bc1eb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 45301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:06:15.162413 1347 consensus_queue.cc:1035] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d41adee2e884578afe8c0b0b804471a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 37367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:06:15.167342 1350 mvcc.cc:205] Tried to move back new op lower bound from 7317077914259324928 to 7317077914176065536. Current Snapshot: MvccSnapshot[applied={T|T < 7317077914259324928}]
I20260810 21:06:15.168244 1356 mvcc.cc:205] Tried to move back new op lower bound from 7317077914259324928 to 7317077914176065536. Current Snapshot: MvccSnapshot[applied={T|T < 7317077914259324928 or (T in {7317077914259324928})}]
I20260810 21:06:15.169649 1354 mvcc.cc:205] Tried to move back new op lower bound from 7317077914259324928 to 7317077914176065536. Current Snapshot: MvccSnapshot[applied={T|T < 7317077914259324928}]
I20260810 21:06:15.176000 479 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:06:15.176139 479 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:06:15.177075 479 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 03a2f4b8171a4755865a6ebbcafea1fe: Sending DeleteTablet for 3 replicas of tablet da659b54400246da908ae76b32005fec
I20260810 21:06:15.177546 715 tablet_service.cc:1514] Processing DeleteTablet for tablet da659b54400246da908ae76b32005fec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:06:15 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:46962
I20260810 21:06:15.177594 940 tablet_service.cc:1514] Processing DeleteTablet for tablet da659b54400246da908ae76b32005fec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:06:15 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:42112
I20260810 21:06:15.177984 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 620
I20260810 21:06:15.177963 1177 tablet_service.cc:1514] Processing DeleteTablet for tablet da659b54400246da908ae76b32005fec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:06:15 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:33268
I20260810 21:06:15.216655 1364 tablet_replica.cc:330] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb: stopping tablet replica
I20260810 21:06:15.216976 1364 raft_consensus.cc:2229] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:06:15.217243 1364 raft_consensus.cc:2258] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:06:15.218551 1364 ts_tablet_manager.cc:1905] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:06:15.218786 1366 tablet_replica.cc:330] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe: stopping tablet replica
I20260810 21:06:15.221020 1364 ts_tablet_manager.cc:1918] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:06:15.221127 1364 log.cc:1196] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/da659b54400246da908ae76b32005fec
I20260810 21:06:15.221436 1364 ts_tablet_manager.cc:1939] T da659b54400246da908ae76b32005fec P aae3c5277f7546bbba7ec56bfc9bc1eb: Deleting consensus metadata
I20260810 21:06:15.221998 1366 raft_consensus.cc:2229] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:06:15.222015 457 catalog_manager.cc:4841] TS aae3c5277f7546bbba7ec56bfc9bc1eb (127.15.37.2:45301): tablet da659b54400246da908ae76b32005fec (table test-table [id=3f736cb9c43d4a44bb5a96b823fbd530]) successfully deleted
I20260810 21:06:15.222187 1366 raft_consensus.cc:2258] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:06:15.222757 1366 ts_tablet_manager.cc:1905] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:06:15.224746 1366 ts_tablet_manager.cc:1918] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:06:15.224908 1366 log.cc:1196] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/da659b54400246da908ae76b32005fec
I20260810 21:06:15.225286 1366 ts_tablet_manager.cc:1939] T da659b54400246da908ae76b32005fec P f0a2c801b1424bf59bf22a523f7d5cbe: Deleting consensus metadata
I20260810 21:06:15.225848 457 catalog_manager.cc:4841] TS f0a2c801b1424bf59bf22a523f7d5cbe (127.15.37.3:42939): tablet da659b54400246da908ae76b32005fec (table test-table [id=3f736cb9c43d4a44bb5a96b823fbd530]) successfully deleted
W20260810 21:06:15.226265 456 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:37367 (error 108)
I20260810 21:06:15.226683 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 852
I20260810 21:06:15.233407 1319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:06:15.233252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:37367 (local address 127.0.0.1:46972)
0810 21:06:15.233316 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 21:06:15.233357 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:37367: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 21:06:15.233712 456 catalog_manager.cc:4584] TS 4d41adee2e884578afe8c0b0b804471a (127.15.37.1:37367): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet da659b54400246da908ae76b32005fec: Network error: Client connection negotiation failed: client connection to 127.15.37.1:37367: connect: Connection refused (error 111)
I20260810 21:06:15.237675 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 1080
I20260810 21:06:15.260741 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 427
I20260810 21:06:15.274066 15508 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 21:06:15.620419 15508 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 21:06:15.620605 15508 mini_ranger.cc:66] Stopping Ranger...
I20260810 21:06:15.976087 15508 mini_ranger.cc:68] Stopped Ranger
2026-08-10 21:06:15.976 UTC [32197] LOG: received smart shutdown request
2026-08-10 21:06:15.981 UTC [32197] LOG: background worker "logical replication launcher" (PID 32215) exited with exit code 1
2026-08-10 21:06:15.982 UTC [32204] LOG: shutting down
2026-08-10 21:06:16.172 UTC [32197] LOG: database system is shut down
2026-08-10T21:06:16Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (54180 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:06:16 dist-test-slave-jq4t krb5kdc[1384](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:06:16 dist-test-slave-jq4t krb5kdc[1384](info): set up 2 sockets
Aug 10 21:06:16 dist-test-slave-jq4t krb5kdc[1384](info): commencing operation
krb5kdc: starting...
W20260810 21:06:17.619567 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.301s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:06:17 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786395977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:06:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:06:17Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.15.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.15.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/rangeradmin_127.15.37.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/rangeradmin_127.15.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.15.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.15.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/rangerlookup_127.15.37.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/rangerlookup_127.15.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.15.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/HTTP_127.15.37.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/HTTP_127.15.37.20@KRBTEST.COM.keytab.
I20260810 21:06:17.812420 15508 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskEugCJs/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/postgres -l logfile start
2026-08-10 21:06:20.524 UTC [1435] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 21:06:20.524 UTC [1435] LOG: listening on IPv4 address "127.15.37.20", port 49631
2026-08-10 21:06:20.528 UTC [1435] LOG: listening on Unix socket "/tmp/.s.PGSQL.49631"
2026-08-10 21:06:20.556 UTC [1445] LOG: database system was shut down at 2026-08-10 21:06:18 UTC
2026-08-10 21:06:20.560 UTC [1435] LOG: database system is ready to accept connections
I20260810 21:06:21.744865 15508 mini_postgres.cc:96] Postgres bound to 49631
2026-08-10 21:06:21.752 UTC [1458] FATAL: database "slave" does not exist
127.15.37.20:49631 - accepting connections
I20260810 21:06:21.753567 15508 mini_ranger.cc:161] Starting Ranger...
I20260810 21:06:21.771795 15508 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 21:06:22.288412 15508 mini_ranger.cc:87] Created ranger Postgres database
I20260810 21:06:22.288533 15508 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-admin
2026-08-10 21:06:22,592 [I] DB FLAVOR :POSTGRES
2026-08-10 21:06:22,592 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 21:06:22,592 [I] Checking connection..
2026-08-10 21:06:22,593 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 21:06:22,880 [I] Checking connection passed.
2026-08-10 21:06:22,881 [I] --------- Verifying version history table ---------
2026-08-10 21:06:22,881 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 21:06:23,168 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 21:06:23,168 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 21:06:23,442 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 21:06:23,443 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 21:06:23,443 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 21:06:23.704 UTC [1566] WARNING: there is no transaction in progress
2026-08-10 21:06:23,711 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 21:06:23,712 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 21:06:23,978 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 21:06:23,979 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 21:06:23,979 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 21:06:24,238 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 21:06:24,512 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-jq4t.c.gcp-upstream.internal','N') ;"
2026-08-10 21:06:24,773 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 21:06:25,025 [I] Table x_portal_user does not exist in database ranger
2026-08-10 21:06:25,025 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 21:06:25,311 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 21:06:25,311 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 21:06:25,599 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 21:06:25,849 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 21:06:25,850 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 21:06:26.921 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:26.940 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:26.960 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:26.977 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:26.996 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:27.018 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:27.081 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:27.089 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:27.109 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:27.122 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:27.134 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:27.150 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:27.161 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:27.168 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:27.177 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:27.186 UTC [1746] WARNING: there is no transaction in progress
2026-08-10 21:06:27,920 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 21:06:27,920 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 21:06:28,193 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 21:06:28,194 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 21:06:28,472 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 21:06:28,472 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 21:06:28,759 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 21:06:28,759 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 21:06:29,043 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 21:06:29,319 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-jq4t.c.gcp-upstream.internal';"
2026-08-10 21:06:29,596 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 21:06:29,597 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 21:06:29,887 [I] DB_PATCHES have already been applied
I20260810 21:06:29.894295 15508 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-admin:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskEugCJs/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 21:06:29.894382 15508 mini_ranger.cc:193] Using host: 127.15.37.20
I20260810 21:06:29.898887 15508 mini_ranger.cc:227] Ranger admin URL: http://127.15.37.20:36419
Aug 10, 2026 9:06:30 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 9:06:30 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 9:06:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 9:06:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 9:06:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 9:06:30 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 9:06:30 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 21:06:31.346732 15508 mini_ranger.cc:160] Time spent starting Ranger: real 9.593s user 0.000s sys 0.012s
Aug 10, 2026 9:06:53 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 9:06:53 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 9:06:53 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 9:06:53 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 9:06:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 9:06:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 9:06:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 9:06:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 9:06:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 9:06:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 9:06:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 9:06:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 9:06:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 9:06:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 9:06:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 9:06:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 9:06:53 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 9:06:54 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 21:06:54.804042 15508 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.15.37.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.15.37.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/rangerkms_127.15.37.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.15.37.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/rangerkms_127.15.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.15.37.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.15.37.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.15.37.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/HTTP_127.15.37.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.15.37.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/HTTP_127.15.37.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 21:06:54 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396014, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 21:06:54.905501 15508 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 21:06:54.917536 15508 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 21:06:55.858714 15508 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 21:06:55.858800 15508 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-kms
I20260810 21:06:55.858814 15508 mini_ranger_kms.cc:227] Using postgres at 127.15.37.20:49631
2026-08-10 21:06:56,050 [I] DB FLAVOR :POSTGRES
2026-08-10 21:06:56,050 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 21:06:56,050 [I] Checking connection
2026-08-10 21:06:56,050 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 21:06:56,331 [I] connection success
2026-08-10 21:06:56,331 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 21:06:56,331 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 21:06:56,332 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 21:06:56,618 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 21:06:56,618 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 21:06:56,618 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 21:06:56,618 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.15.37.20:49631/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 21:06:56,939 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 21:06:57.460525 15508 mini_ranger_kms.cc:310] Created kms service
I20260810 21:06:57.641278 15508 mini_ranger_kms.cc:326] Created kudu user
I20260810 21:06:57.694106 15508 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 21:06:57 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396014, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:06:58.132042 15508 mini_ranger_kms.cc:384] Added ranger policy
I20260810 21:06:58.132284 15508 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-kms:/tmp/dist-test-taskEugCJs/build/release/bin/postgresql.jar:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskEugCJs/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 21:06:58.132316 15508 mini_ranger_kms.cc:240] Using host: 127.15.37.20
I20260810 21:06:58.136694 15508 mini_ranger_kms.cc:276] Ranger KMS PID: 2048
I20260810 21:06:58.136791 15508 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.15.37.20:45961
Aug 10, 2026 9:06:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 9:06:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 9:06:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 9:06:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 9:06:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 9:06:59 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 21:07:00 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786396020, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.37.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 10 21:07:00 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396020, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.37.20@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:07:00.980681 15508 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.075s user 0.012s sys 0.161s
I20260810 21:07:00.980787 15508 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 21:07:00.980834 15508 mini_ranger_kms.cc:401] 127.15.37.20:45961/kms/v1/keys
Aug 10 21:07:01 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396020, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.15.37.20@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
Aug 10 21:07:03 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:07:03.700201 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:42689
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:42689
--ranger_config_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.37.20:45961/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:03.796891 2121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:03.797173 2121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:03.797219 2121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:03.798544 2121 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:07:03.798625 2121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:03.798650 2121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:03.798669 2121 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:07:03.798702 2121 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:07:03.800637 2121 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/wal
--ranger_kms_url=127.15.37.20:45961/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:42689
--ranger_config_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:42689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:03.800951 2121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:03.801235 2121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:03.808297 2135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:03.808297 2137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:03.808359 2131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:03.809049 2121 server_base.cc:1034] running on GCE node
I20260810 21:07:03.809346 2121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:03.809733 2121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:03.811065 2121 hybrid_clock.cc:648] HybridClock initialized: now 1786396023811020 us; error 40 us; skew 500 ppm
Aug 10 21:07:03 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396023, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:03.814567 2121 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:07:03.815114 2121 webserver.cc:460] Webserver started at http://127.15.37.62:40767/ using document root <none> and password file <none>
I20260810 21:07:03.815398 2121 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:03.815465 2121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:03.815639 2121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 21:07:03 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396023, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:07:03.875955 2121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "b50554f35a194938bac6e09e4a65775a"
format_stamp: "Formatted at 2026-08-10 21:07:03 on dist-test-slave-jq4t"
server_key: "203c0b279dbb9d2a3309ab9aa7b0d68c"
server_key_iv: "d9aa1b4497f587447c6c2ab88dccb406"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:03.876551 2121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "b50554f35a194938bac6e09e4a65775a"
format_stamp: "Formatted at 2026-08-10 21:07:03 on dist-test-slave-jq4t"
server_key: "203c0b279dbb9d2a3309ab9aa7b0d68c"
server_key_iv: "d9aa1b4497f587447c6c2ab88dccb406"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:03.878696 2121 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260810 21:07:03.891989 2155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:03.892374 2121 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:03.892596 2121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "b50554f35a194938bac6e09e4a65775a"
format_stamp: "Formatted at 2026-08-10 21:07:03 on dist-test-slave-jq4t"
server_key: "203c0b279dbb9d2a3309ab9aa7b0d68c"
server_key_iv: "d9aa1b4497f587447c6c2ab88dccb406"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:03.892745 2121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:03.912580 2121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:03.914709 2121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:03.914902 2121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:03.920222 2121 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:42689
I20260810 21:07:03.920259 2259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:42689 every 8 connection(s)
I20260810 21:07:03.920717 2121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:07:03.921582 2260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:03.924978 2260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a: Bootstrap starting.
I20260810 21:07:03.925899 2260 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:03.926272 2260 log.cc:824] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:03.927196 2260 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a: No bootstrap required, opened a new log
I20260810 21:07:03.929023 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 2121
I20260810 21:07:03.929152 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:07:03.929345 15508 external_mini_cluster.cc:1428] Setting key 0a16210db791b700192381b08d9afca6
I20260810 21:07:03.930214 2260 raft_consensus.cc:348] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b50554f35a194938bac6e09e4a65775a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42689 } }
I20260810 21:07:03.930430 2260 raft_consensus.cc:374] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:03.930465 2260 raft_consensus.cc:729] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b50554f35a194938bac6e09e4a65775a, State: Initialized, Role: FOLLOWER
I20260810 21:07:03.930661 2260 consensus_queue.cc:260] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b50554f35a194938bac6e09e4a65775a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42689 } }
I20260810 21:07:03.930761 2260 raft_consensus.cc:388] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:07:03.930862 2260 raft_consensus.cc:482] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:07:03.930923 2260 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:03.931766 2260 raft_consensus.cc:504] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b50554f35a194938bac6e09e4a65775a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42689 } }
I20260810 21:07:03.931888 2260 leader_election.cc:302] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b50554f35a194938bac6e09e4a65775a; no voters:
I20260810 21:07:03.932124 2260 leader_election.cc:288] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:07:03.932222 2268 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:07:03.932420 2268 raft_consensus.cc:686] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 1 LEADER]: Becoming Leader. State: Replica: b50554f35a194938bac6e09e4a65775a, State: Running, Role: LEADER
I20260810 21:07:03.932591 2268 consensus_queue.cc:237] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b50554f35a194938bac6e09e4a65775a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42689 } }
I20260810 21:07:03.932449 2260 sys_catalog.cc:564] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:07:03.934263 2260 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 21:07:03.934269 2272 sys_catalog.cc:455] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b50554f35a194938bac6e09e4a65775a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b50554f35a194938bac6e09e4a65775a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42689 } } }
I20260810 21:07:03.934428 2272 sys_catalog.cc:458] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:03.934662 2273 sys_catalog.cc:455] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b50554f35a194938bac6e09e4a65775a. Latest consensus state: current_term: 1 leader_uuid: "b50554f35a194938bac6e09e4a65775a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b50554f35a194938bac6e09e4a65775a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42689 } } }
I20260810 21:07:03.934724 2273 sys_catalog.cc:458] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:03.934836 2294 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 10 21:07:03 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:03.937834 2294 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:07:03.941720 2294 catalog_manager.cc:1347] Generated new cluster ID: ddbe833b92ac4295958645bcda5671c5
I20260810 21:07:03.941787 2294 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:07:03.944222 2267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:03.930014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33658 (local address 127.15.37.62:42689)
0810 21:07:03.930286 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:03.930295 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:03.930322 (+ 27us) server_negotiation.cc:407] Connection header received
0810 21:07:03.930459 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:03.930467 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:03.930543 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:03.931479 (+ 936us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:03.931589 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:03.933042 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:03.934231 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:03.934941 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:03.935065 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:03.938493 (+ 3428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:03.938548 (+ 55us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:03.938549 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:03.938634 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:03.941605 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:03.942093 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:03.942097 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:03.942098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:03.942249 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:03.942457 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:03.942458 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:03.942459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:03.942845 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:03.943020 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:03.943520 (+ 500us) server_negotiation.cc:299] Negotiation successful
0810 21:07:03.943866 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":118,"threads_started":1}
I20260810 21:07:03.966756 2294 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:07:03.967648 2294 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:07:03.976054 2294 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a: Generated new TSK 0
I20260810 21:07:03.976393 2294 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:07:04.695659 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.37.20:45961/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42689
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:04.794584 2344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:04.794831 2344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:04.794857 2344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:04.796273 2344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:04.796321 2344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:04.796350 2344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:07:04.798055 2344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.15.37.20:45961/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:04.798338 2344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:04.798626 2344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:04.804445 2351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:04.804452 2356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:04.804452 2352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:04.804978 2344 server_base.cc:1034] running on GCE node
I20260810 21:07:04.805234 2344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:04.805562 2344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:04.806766 2344 hybrid_clock.cc:648] HybridClock initialized: now 1786396024806752 us; error 31 us; skew 500 ppm
Aug 10 21:07:04 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396024, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:04.810382 2344 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:07:04.810969 2344 webserver.cc:460] Webserver started at http://127.15.37.1:43863/ using document root <none> and password file <none>
I20260810 21:07:04.811220 2344 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:04.811292 2344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:04.811450 2344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 21:07:04 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396024, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:07:04.830309 2344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "274b613a8aee49dd8cc9c3db70cf9029"
format_stamp: "Formatted at 2026-08-10 21:07:04 on dist-test-slave-jq4t"
server_key: "b3cbbf55caa9b8cd47d5f987ef634349"
server_key_iv: "8e3c28c1f1363194d0c664a5e807c177"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:04.830890 2344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "274b613a8aee49dd8cc9c3db70cf9029"
format_stamp: "Formatted at 2026-08-10 21:07:04 on dist-test-slave-jq4t"
server_key: "b3cbbf55caa9b8cd47d5f987ef634349"
server_key_iv: "8e3c28c1f1363194d0c664a5e807c177"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:04.833024 2344 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 21:07:04.847541 2366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:04.847784 2344 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:07:04.847900 2344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "274b613a8aee49dd8cc9c3db70cf9029"
format_stamp: "Formatted at 2026-08-10 21:07:04 on dist-test-slave-jq4t"
server_key: "b3cbbf55caa9b8cd47d5f987ef634349"
server_key_iv: "8e3c28c1f1363194d0c664a5e807c177"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:04.848030 2344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:04.867537 2344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:04.869943 2344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:04.870143 2344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:04.870451 2344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:04.870883 2344 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:04.870939 2344 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:04.870980 2344 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:04.871006 2344 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:04.880321 2344 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:33841
I20260810 21:07:04.880888 2344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:07:04.881527 2557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:33841 every 8 connection(s)
I20260810 21:07:04.884893 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 2344
I20260810 21:07:04.885013 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:07:04.885226 15508 external_mini_cluster.cc:1428] Setting key 99e1957fe08392e76dffd3adc5496963
Aug 10 21:07:04 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396024, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:04.894577 2562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:04.881908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42689 (local address 127.15.37.1:46763)
0810 21:07:04.882466 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:04.882517 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:04.883139 (+ 622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:04.883560 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:04.883565 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:04.883843 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:04.884152 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:04.884158 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:04.885245 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:04.885247 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:04.886614 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:04.886618 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:04.887252 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:04.887254 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:04.887415 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:04.888121 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:04.888134 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:04.890012 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:04.892463 (+ 2451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:04.892511 (+ 48us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:04.892514 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:04.892885 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:04.893138 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:04.893139 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:04.893139 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:04.893290 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:04.893665 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:04.893674 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:04.893901 (+ 227us) client_negotiation.cc:769] Sending connection context
0810 21:07:04.894033 (+ 132us) client_negotiation.cc:240] Negotiation successful
0810 21:07:04.894237 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":87,"threads_started":1}
I20260810 21:07:04.895579 2563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:04.881919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:46763 (local address 127.15.37.62:42689)
0810 21:07:04.882100 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:04.882102 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:04.882623 (+ 521us) server_negotiation.cc:407] Connection header received
0810 21:07:04.883323 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:04.883324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:04.883340 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:04.883411 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:04.884273 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:04.885125 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:04.886718 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:04.887091 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:04.887160 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:04.890151 (+ 2991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:04.890153 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:04.890153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:04.890162 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:04.892334 (+ 2172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:04.892987 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:04.892989 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:04.892989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:04.893062 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:04.893382 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:04.893384 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:04.893384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:04.893560 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:04.893631 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:04.895335 (+ 1704us) server_negotiation.cc:299] Negotiation successful
0810 21:07:04.895460 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":111,"threads_started":1}
I20260810 21:07:04.896102 2560 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42689
I20260810 21:07:04.896214 2560 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:04.896454 2560 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
I20260810 21:07:04.897289 2187 ts_manager.cc:194] Registered new tserver with Master: 274b613a8aee49dd8cc9c3db70cf9029 (127.15.37.1:33841)
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
I20260810 21:07:04.898296 2187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:46763
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:07:04.919639 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.37.20:45961/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42689
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:05.035229 2569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:05.035595 2569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:05.035640 2569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:05.037727 2569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:05.037815 2569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:05.037871 2569 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:07:05.040436 2569 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.15.37.20:45961/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:05.040777 2569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:05.041117 2569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:05.048274 2588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:05.048307 2583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:05.048628 2584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:05.049809 2569 server_base.cc:1034] running on GCE node
I20260810 21:07:05.050125 2569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:05.050458 2569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:05.051637 2569 hybrid_clock.cc:648] HybridClock initialized: now 1786396025051609 us; error 54 us; skew 500 ppm
Aug 10 21:07:05 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396025, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:05.055312 2569 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:07:05.055989 2569 webserver.cc:460] Webserver started at http://127.15.37.2:37877/ using document root <none> and password file <none>
I20260810 21:07:05.056300 2569 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:05.056382 2569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:05.056582 2569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 21:07:05 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396025, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:07:05.076047 2569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "e7a27295d79e4e518b7778033f194312"
format_stamp: "Formatted at 2026-08-10 21:07:05 on dist-test-slave-jq4t"
server_key: "d519d343899c1e0712b3841219152af7"
server_key_iv: "82e7f29151b70059119ca7e62a968b9c"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:05.076588 2569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "e7a27295d79e4e518b7778033f194312"
format_stamp: "Formatted at 2026-08-10 21:07:05 on dist-test-slave-jq4t"
server_key: "d519d343899c1e0712b3841219152af7"
server_key_iv: "82e7f29151b70059119ca7e62a968b9c"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:05.084928 2569 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.002s sys 0.000s
Aug 10 21:07:05 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786396025, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:05.104768 2600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:05.105021 2569 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260810 21:07:05.105145 2569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "e7a27295d79e4e518b7778033f194312"
format_stamp: "Formatted at 2026-08-10 21:07:05 on dist-test-slave-jq4t"
server_key: "d519d343899c1e0712b3841219152af7"
server_key_iv: "82e7f29151b70059119ca7e62a968b9c"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:05.105278 2569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:05.129914 2569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:05.132761 2569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:05.132965 2569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:05.133215 2569 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:05.133636 2569 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:05.133695 2569 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:05.133738 2569 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:05.133765 2569 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:05.142470 2569 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:35619
I20260810 21:07:05.142835 2802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:35619 every 8 connection(s)
I20260810 21:07:05.143033 2569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
Aug 10 21:07:05 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396025, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:05.149505 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 2569
I20260810 21:07:05.149659 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:07:05.149868 15508 external_mini_cluster.cc:1428] Setting key ff33f969a3b6342d3899ae38333f00dd
I20260810 21:07:05.153805 2563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:05.143921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:37751 (local address 127.15.37.62:42689)
0810 21:07:05.144003 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:05.144006 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:05.144303 (+ 297us) server_negotiation.cc:407] Connection header received
0810 21:07:05.144945 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:05.144946 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:05.144962 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:05.145015 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:05.145614 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:05.146152 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:05.147212 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:05.147435 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:05.147528 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:05.150029 (+ 2501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:05.150031 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:05.150031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:05.150040 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:05.152043 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:05.152576 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:05.152577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:05.152578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:05.152644 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:05.152945 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:05.152947 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:05.152947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:05.153093 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:05.153147 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:05.153552 (+ 405us) server_negotiation.cc:299] Negotiation successful
0810 21:07:05.153672 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 21:07:05.153899 2805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:05.143892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42689 (local address 127.15.37.2:37751)
0810 21:07:05.144172 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:05.144205 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:05.144818 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:05.145095 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:05.145099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:05.145296 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:05.145507 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:05.145512 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:05.146279 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:05.146280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:05.147115 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:05.147117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:05.147552 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:05.147553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:05.147674 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:05.148267 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:05.148276 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:05.149891 (+ 1615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:05.152135 (+ 2244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:05.152143 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:05.152146 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:05.152459 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:05.152718 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:05.152719 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:05.152719 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:05.152859 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:05.153178 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:05.153183 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:05.153366 (+ 183us) client_negotiation.cc:769] Sending connection context
0810 21:07:05.153478 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 21:07:05.153649 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":108,"threads_started":1}
I20260810 21:07:05.154800 2803 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42689
I20260810 21:07:05.154935 2803 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:05.155179 2803 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
I20260810 21:07:05.155637 2187 ts_manager.cc:194] Registered new tserver with Master: e7a27295d79e4e518b7778033f194312 (127.15.37.2:35619)
I20260810 21:07:05.156131 2187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:37751
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:07:05.184141 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.37.20:45961/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42689
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:05.286825 2813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:05.287225 2813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:05.287319 2813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:05.289198 2813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:05.289327 2813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:05.289425 2813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:07:05.291865 2813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.15.37.20:45961/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2813
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:05.292430 2813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:05.292876 2813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:05.299075 2824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:05.299197 2826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:05.299082 2823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:05.300261 2813 server_base.cc:1034] running on GCE node
I20260810 21:07:05.300549 2813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:05.300843 2813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:05.302012 2813 hybrid_clock.cc:648] HybridClock initialized: now 1786396025301995 us; error 41 us; skew 500 ppm
Aug 10 21:07:05 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396025, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:05.304839 2813 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:07:05.305416 2813 webserver.cc:460] Webserver started at http://127.15.37.3:33209/ using document root <none> and password file <none>
I20260810 21:07:05.305696 2813 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:05.305766 2813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:05.305924 2813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 21:07:05 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396025, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:07:05.317911 2813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "a63bcd84370f4d3b9e1349af64a48a2f"
format_stamp: "Formatted at 2026-08-10 21:07:05 on dist-test-slave-jq4t"
server_key: "ee9e4358241f3a6dd8fe947986a26521"
server_key_iv: "00b18e29cbbdd0cae4dc185f776ba2c9"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:05.318428 2813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "a63bcd84370f4d3b9e1349af64a48a2f"
format_stamp: "Formatted at 2026-08-10 21:07:05 on dist-test-slave-jq4t"
server_key: "ee9e4358241f3a6dd8fe947986a26521"
server_key_iv: "00b18e29cbbdd0cae4dc185f776ba2c9"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:05.325682 2813 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.000s
I20260810 21:07:05.343523 2840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:05.343779 2813 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260810 21:07:05.343884 2813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "a63bcd84370f4d3b9e1349af64a48a2f"
format_stamp: "Formatted at 2026-08-10 21:07:05 on dist-test-slave-jq4t"
server_key: "ee9e4358241f3a6dd8fe947986a26521"
server_key_iv: "00b18e29cbbdd0cae4dc185f776ba2c9"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:05.344009 2813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:05.368005 2813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:05.370921 2813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:05.371119 2813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:05.371348 2813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:05.371719 2813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:05.371780 2813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:05.371824 2813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:05.371852 2813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:05.378994 2813 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:45123
I20260810 21:07:05.379093 3040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:45123 every 8 connection(s)
I20260810 21:07:05.379428 2813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:07:05.384145 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 2813
I20260810 21:07:05.384392 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:07:05.384790 15508 external_mini_cluster.cc:1428] Setting key c4b469720e351047f2d4be53ac884f0b
Aug 10 21:07:05 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396025, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:05.391834 2563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:05.380431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:60299 (local address 127.15.37.62:42689)
0810 21:07:05.380530 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:05.380532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:05.380628 (+ 96us) server_negotiation.cc:407] Connection header received
0810 21:07:05.381431 (+ 803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:05.381432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:05.381442 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:05.381489 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:05.382311 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:05.382828 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:05.384399 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:05.384723 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:05.384770 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:05.388224 (+ 3454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:05.388226 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:05.388226 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:05.388253 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:05.390164 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:05.390674 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:05.390676 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:05.390676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:05.390750 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:05.391059 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:05.391060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:05.391060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:05.391202 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:05.391282 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:05.391638 (+ 356us) server_negotiation.cc:299] Negotiation successful
0810 21:07:05.391733 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260810 21:07:05.392050 3044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:05.380222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42689 (local address 127.15.37.3:60299)
0810 21:07:05.380422 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:05.380509 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:05.381301 (+ 792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:05.381589 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:05.381593 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:05.381884 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:05.382203 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:05.382209 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:05.382929 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:05.382930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:05.384231 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:05.384234 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:05.384943 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:05.384944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:05.385096 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:05.385861 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:05.385874 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:05.388075 (+ 2201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:05.390266 (+ 2191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:05.390278 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:05.390282 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:05.390569 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:05.390833 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:05.390834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:05.390834 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:05.390983 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:05.391274 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:05.391281 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:05.391475 (+ 194us) client_negotiation.cc:769] Sending connection context
0810 21:07:05.391604 (+ 129us) client_negotiation.cc:240] Negotiation successful
0810 21:07:05.391790 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":75,"threads_started":1}
I20260810 21:07:05.392750 3041 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42689
I20260810 21:07:05.392879 3041 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:05.393106 3041 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
I20260810 21:07:05.393564 2187 ts_manager.cc:194] Registered new tserver with Master: a63bcd84370f4d3b9e1349af64a48a2f (127.15.37.3:45123)
I20260810 21:07:05.394068 2187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:60299
I20260810 21:07:05.397207 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:07:05.398135 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 2344
I20260810 21:07:05.425065 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 2569
I20260810 21:07:05.440349 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 2813
I20260810 21:07:05.470494 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 2121
I20260810 21:07:05.484683 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:42689
--webserver_interface=127.15.37.62
--webserver_port=40767
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:42689
--ranger_config_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.37.20:45961/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.37.20:45961/kms with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:05.574368 3047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:05.574620 3047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:05.574645 3047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:05.576076 3047 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:07:05.576159 3047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:05.576174 3047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:05.576187 3047 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:07:05.576200 3047 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:07:05.578130 3047 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.37.20:45961/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:42689
--ranger_config_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:42689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=40767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:05.578455 3047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:05.578733 3047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:05.584456 3061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:05.584450 3054 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:05.584694 3047 server_base.cc:1034] running on GCE node
W20260810 21:07:05.584448 3057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:05.585076 3047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:05.585441 3047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:05.586627 3047 hybrid_clock.cc:648] HybridClock initialized: now 1786396025586613 us; error 40 us; skew 500 ppm
Aug 10 21:07:05 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396025, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:05.589421 3047 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:07:05.589917 3047 webserver.cc:460] Webserver started at http://127.15.37.62:40767/ using document root <none> and password file <none>
I20260810 21:07:05.590188 3047 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:05.590273 3047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 21:07:05 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396025, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:07:05.629088 3047 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:07:05.629956 3075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:05.630192 3047 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:05.630301 3047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "b50554f35a194938bac6e09e4a65775a"
format_stamp: "Formatted at 2026-08-10 21:07:03 on dist-test-slave-jq4t"
server_key: "203c0b279dbb9d2a3309ab9aa7b0d68c"
server_key_iv: "d9aa1b4497f587447c6c2ab88dccb406"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:05.630838 3047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:05.641635 3047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:05.643502 3047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:05.643687 3047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:05.648232 3047 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:42689
I20260810 21:07:05.648272 3168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:42689 every 8 connection(s)
I20260810 21:07:05.648810 3047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:07:05.650148 3170 sys_catalog.cc:263] Verifying existing consensus state
I20260810 21:07:05.650923 3170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a: Bootstrap starting.
I20260810 21:07:05.651278 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 3047
I20260810 21:07:05.651619 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.37.20:45961/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:33841
--local_ip_for_outbound_sockets=127.15.37.1
--tserver_master_addrs=127.15.37.62:42689
--webserver_port=43863
--webserver_interface=127.15.37.1
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.37.20:45961/kms with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:07:05.659972 3170 log.cc:824] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:05.662248 3170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 21:07:05.662593 3170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a: Bootstrap complete.
I20260810 21:07:05.665246 3170 raft_consensus.cc:348] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b50554f35a194938bac6e09e4a65775a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42689 } }
I20260810 21:07:05.665530 3170 raft_consensus.cc:729] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b50554f35a194938bac6e09e4a65775a, State: Initialized, Role: FOLLOWER
I20260810 21:07:05.665729 3170 consensus_queue.cc:260] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b50554f35a194938bac6e09e4a65775a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42689 } }
I20260810 21:07:05.665812 3170 raft_consensus.cc:388] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:07:05.665891 3170 raft_consensus.cc:482] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:07:05.665946 3170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 1 FOLLOWER]: Advancing to term 2
I20260810 21:07:05.667063 3170 raft_consensus.cc:504] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b50554f35a194938bac6e09e4a65775a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42689 } }
I20260810 21:07:05.667194 3170 leader_election.cc:302] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b50554f35a194938bac6e09e4a65775a; no voters:
I20260810 21:07:05.667398 3170 leader_election.cc:288] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 21:07:05.667483 3180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 2 FOLLOWER]: Leader election won for term 2
I20260810 21:07:05.667647 3180 raft_consensus.cc:686] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [term 2 LEADER]: Becoming Leader. State: Replica: b50554f35a194938bac6e09e4a65775a, State: Running, Role: LEADER
I20260810 21:07:05.667706 3170 sys_catalog.cc:564] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:07:05.667749 3180 consensus_queue.cc:237] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b50554f35a194938bac6e09e4a65775a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42689 } }
I20260810 21:07:05.668021 3180 sys_catalog.cc:455] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b50554f35a194938bac6e09e4a65775a. Latest consensus state: current_term: 2 leader_uuid: "b50554f35a194938bac6e09e4a65775a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b50554f35a194938bac6e09e4a65775a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42689 } } }
I20260810 21:07:05.668188 3180 sys_catalog.cc:458] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:05.668022 3183 sys_catalog.cc:455] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b50554f35a194938bac6e09e4a65775a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b50554f35a194938bac6e09e4a65775a" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42689 } } }
I20260810 21:07:05.668573 3183 sys_catalog.cc:458] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:05.668641 3191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:07:05.669202 3191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:07:05.669337 3191 catalog_manager.cc:1259] Loaded cluster ID: ddbe833b92ac4295958645bcda5671c5
I20260810 21:07:05.669373 3191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:07:05.669595 3170 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 21:07:05.673449 3191 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:07:05.674152 3191 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a: Loaded TSK: 0
I20260810 21:07:05.674508 3191 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 21:07:05.752665 3177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:05.753005 3177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:05.753067 3177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:05.755340 3177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:05.755417 3177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:05.755470 3177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:07:05.758423 3177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.37.20:45961/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:33841
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=43863
--tserver_master_addrs=127.15.37.62:42689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:05.758767 3177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:05.759092 3177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:05.765569 3246 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:05.765569 3249 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:05.765976 3247 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:05.766502 3177 server_base.cc:1034] running on GCE node
I20260810 21:07:05.766739 3177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:05.767019 3177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:05.768213 3177 hybrid_clock.cc:648] HybridClock initialized: now 1786396025768180 us; error 46 us; skew 500 ppm
Aug 10 21:07:05 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396025, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:05.772320 3177 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:07:05.772989 3177 webserver.cc:460] Webserver started at http://127.15.37.1:43863/ using document root <none> and password file <none>
I20260810 21:07:05.773289 3177 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:05.773382 3177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 21:07:05 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396025, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:07:05.799141 3177 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:05.800026 3261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:05.800597 3177 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:05.800715 3177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "274b613a8aee49dd8cc9c3db70cf9029"
format_stamp: "Formatted at 2026-08-10 21:07:04 on dist-test-slave-jq4t"
server_key: "b3cbbf55caa9b8cd47d5f987ef634349"
server_key_iv: "8e3c28c1f1363194d0c664a5e807c177"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:05.801213 3177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:05.867404 3177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:05.870172 3177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:05.870352 3177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:05.870637 3177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:05.871084 3177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:05.871138 3177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:05.871172 3177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:05.871191 3177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:05.878549 3177 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:33841
I20260810 21:07:05.878845 3461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:33841 every 8 connection(s)
I20260810 21:07:05.879077 3177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:07:05.880749 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 3177
I20260810 21:07:05.881071 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.37.20:45961/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:35619
--local_ip_for_outbound_sockets=127.15.37.2
--tserver_master_addrs=127.15.37.62:42689
--webserver_port=37877
--webserver_interface=127.15.37.2
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.37.20:45961/kms with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 21:07:05 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396025, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:05.898128 3470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:05.880189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:60649 (local address 127.15.37.62:42689)
0810 21:07:05.880408 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:05.880419 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:05.880571 (+ 152us) server_negotiation.cc:407] Connection header received
0810 21:07:05.885235 (+ 4664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:05.885245 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:05.885324 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:05.885461 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:05.886472 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:05.887957 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:05.889616 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:05.890292 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:05.890388 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:05.893420 (+ 3032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:05.893425 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:05.893426 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:05.893440 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:05.895792 (+ 2352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:05.896354 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:05.896359 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:05.896359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:05.896503 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:05.896844 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:05.896846 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:05.896846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:05.897179 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:05.897260 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:05.897705 (+ 445us) server_negotiation.cc:299] Negotiation successful
0810 21:07:05.897868 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":95,"threads_started":1}
I20260810 21:07:05.898758 3465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:05.879944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42689 (local address 127.15.37.1:60649)
0810 21:07:05.880380 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:05.880423 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:05.884892 (+ 4469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:05.885708 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:05.885712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:05.886016 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:05.886320 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:05.886327 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:05.888106 (+ 1779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:05.888107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:05.889504 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:05.889507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:05.890540 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:05.890541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:05.890678 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:05.891410 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:05.891422 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:05.893276 (+ 1854us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:05.895913 (+ 2637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:05.895920 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:05.895923 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:05.896241 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:05.896589 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:05.896590 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:05.896590 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:05.896743 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:05.897302 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:05.897309 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:05.897486 (+ 177us) client_negotiation.cc:769] Sending connection context
0810 21:07:05.898354 (+ 868us) client_negotiation.cc:240] Negotiation successful
0810 21:07:05.898527 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":105,"threads_started":1}
I20260810 21:07:05.899566 3462 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42689
I20260810 21:07:05.899678 3462 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:05.899907 3462 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
W20260810 21:07:05.900868 3462 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:42689 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 21:07:05.900945 3462 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:05.901021 3462 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
I20260810 21:07:05.901348 3462 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:05.901419 3462 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
W20260810 21:07:05.901697 3462 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 21:07:05.997592 3471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:05.997848 3471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:05.997895 3471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:05.999744 3471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:05.999826 3471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:05.999873 3471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:07:06.001911 3471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.37.20:45961/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:35619
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=37877
--tserver_master_addrs=127.15.37.62:42689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:06.002243 3471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:06.002560 3471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:06.008769 3480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:06.009127 3482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:06.009585 3471 server_base.cc:1034] running on GCE node
W20260810 21:07:06.016458 3488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:06.016919 3471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:06.017313 3471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:06.018615 3471 hybrid_clock.cc:648] HybridClock initialized: now 1786396026018585 us; error 74 us; skew 500 ppm
Aug 10 21:07:06 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396026, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:06.022125 3471 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:07:06.022743 3471 webserver.cc:460] Webserver started at http://127.15.37.2:37877/ using document root <none> and password file <none>
I20260810 21:07:06.023057 3471 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:06.023128 3471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 21:07:06 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396026, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:07:06.049217 3471 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.001s sys 0.000s
I20260810 21:07:06.050146 3503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:06.050405 3471 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:06.050537 3471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "e7a27295d79e4e518b7778033f194312"
format_stamp: "Formatted at 2026-08-10 21:07:05 on dist-test-slave-jq4t"
server_key: "d519d343899c1e0712b3841219152af7"
server_key_iv: "82e7f29151b70059119ca7e62a968b9c"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:06.050971 3471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:06.075419 3471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:06.078138 3471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:06.078346 3471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:06.078661 3471 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:06.079044 3471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:06.079105 3471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:06.079152 3471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:06.079180 3471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:06.087303 3471 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:35619
I20260810 21:07:06.087425 3721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:35619 every 8 connection(s)
I20260810 21:07:06.087834 3471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:07:06.089797 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 3471
I20260810 21:07:06.090142 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.15.37.20:45961/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:45123
--local_ip_for_outbound_sockets=127.15.37.3
--tserver_master_addrs=127.15.37.62:42689
--webserver_port=33209
--webserver_interface=127.15.37.3
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.15.37.20:45961/kms with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 21:07:06 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396026, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:06.103082 3470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:06.088803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:55641 (local address 127.15.37.62:42689)
0810 21:07:06.088890 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:06.088893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:06.089127 (+ 234us) server_negotiation.cc:407] Connection header received
0810 21:07:06.089790 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:06.089791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:06.089807 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:06.089853 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:06.091274 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:06.092072 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:06.093700 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:06.094064 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:06.094113 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:06.098633 (+ 4520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:06.098635 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:06.098636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:06.098647 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:06.100893 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:06.101606 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:06.101608 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:06.101609 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:06.101684 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:06.102065 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:06.102066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:06.102067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:06.102253 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:06.102308 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:06.102819 (+ 511us) server_negotiation.cc:299] Negotiation successful
0810 21:07:06.102929 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 21:07:06.103775 3724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:06.088786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42689 (local address 127.15.37.2:55641)
0810 21:07:06.088988 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:06.089033 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:06.089644 (+ 611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:06.090171 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:06.090176 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:06.090789 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:06.091145 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:06.091152 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:06.092207 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:06.092210 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:06.093578 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:06.093582 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:06.094226 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:06.094227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:06.094352 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:06.096660 (+ 2308us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:06.096672 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:06.098488 (+ 1816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:06.101032 (+ 2544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:06.101044 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:06.101048 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:06.101487 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:06.101774 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:06.101775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:06.101776 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:06.101970 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:06.102382 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:06.102390 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:06.102629 (+ 239us) client_negotiation.cc:769] Sending connection context
0810 21:07:06.103217 (+ 588us) client_negotiation.cc:240] Negotiation successful
0810 21:07:06.103450 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":121,"threads_started":1}
I20260810 21:07:06.104563 3722 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42689
I20260810 21:07:06.104697 3722 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:06.104954 3722 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
W20260810 21:07:06.105837 3722 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:42689 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 21:07:06.105931 3722 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:06.106014 3722 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
I20260810 21:07:06.106433 3722 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:06.106539 3722 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
W20260810 21:07:06.106945 3722 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 21:07:06.202107 3725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:06.202374 3725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:06.202417 3725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:06.204279 3725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:06.204367 3725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:06.204420 3725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:07:06.206910 3725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.15.37.20:45961/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:45123
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=33209
--tserver_master_addrs=127.15.37.62:42689
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:06.207250 3725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:06.207548 3725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:06.217666 3743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:06.217666 3745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:06.218477 3741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:06.218817 3725 server_base.cc:1034] running on GCE node
I20260810 21:07:06.219074 3725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:06.219384 3725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:06.220561 3725 hybrid_clock.cc:648] HybridClock initialized: now 1786396026220528 us; error 45 us; skew 500 ppm
Aug 10 21:07:06 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396026, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:06.224113 3725 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:07:06.224807 3725 webserver.cc:460] Webserver started at http://127.15.37.3:33209/ using document root <none> and password file <none>
I20260810 21:07:06.225124 3725 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:06.225209 3725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 21:07:06 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396026, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:07:06.240899 3725 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:06.241815 3762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:06.242122 3725 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:06.242225 3725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "a63bcd84370f4d3b9e1349af64a48a2f"
format_stamp: "Formatted at 2026-08-10 21:07:05 on dist-test-slave-jq4t"
server_key: "ee9e4358241f3a6dd8fe947986a26521"
server_key_iv: "00b18e29cbbdd0cae4dc185f776ba2c9"
server_key_version: "kuduclusterkey@0"
I20260810 21:07:06.242728 3725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:06.254338 3725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:06.257193 3725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:06.257408 3725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:06.257799 3725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:06.258244 3725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:06.258301 3725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:06.258333 3725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:06.258350 3725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:06.267102 3725 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:45123
I20260810 21:07:06.267304 3963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:45123 every 8 connection(s)
I20260810 21:07:06.267716 3725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:07:06.269276 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 3725
Aug 10 21:07:06 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396026, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:06.279894 3470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:06.268734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:38751 (local address 127.15.37.62:42689)
0810 21:07:06.268809 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:06.268811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:06.269056 (+ 245us) server_negotiation.cc:407] Connection header received
0810 21:07:06.269792 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:06.269794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:06.269808 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:06.269840 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:06.270710 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:06.271400 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:06.272998 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:06.273293 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:06.273360 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:06.276040 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:06.276042 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:06.276043 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:06.276051 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:06.278028 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:06.278592 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:06.278594 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:06.278594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:06.278660 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:06.279040 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:06.279042 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:06.279042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:06.279196 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:06.279280 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:06.279687 (+ 407us) server_negotiation.cc:299] Negotiation successful
0810 21:07:06.279781 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 21:07:06.280102 3969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:06.268711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42689 (local address 127.15.37.3:38751)
0810 21:07:06.268899 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:06.268951 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:06.269663 (+ 712us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:06.270035 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:06.270039 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:06.270290 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:06.270591 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:06.270596 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:06.271524 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:06.271525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:06.272901 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:06.272904 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:06.273453 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:06.273454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:06.273573 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:06.274196 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:06.274206 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:06.275934 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:06.278131 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:06.278139 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:06.278143 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:06.278495 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:06.278748 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:06.278750 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:06.278750 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:06.278938 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:06.279291 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:06.279299 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:06.279518 (+ 219us) client_negotiation.cc:769] Sending connection context
0810 21:07:06.279662 (+ 144us) client_negotiation.cc:240] Negotiation successful
0810 21:07:06.279831 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":109,"threads_started":1}
I20260810 21:07:06.280586 3964 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42689
I20260810 21:07:06.280697 3964 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:06.280921 3964 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
I20260810 21:07:06.281884 3973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:06.269729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47614 (local address 127.15.37.62:42689)
0810 21:07:06.270744 (+ 1015us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:06.270746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:06.270977 (+ 231us) server_negotiation.cc:407] Connection header received
0810 21:07:06.271000 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:06.271001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:06.271012 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:06.271076 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:06.272582 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:06.273246 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:06.274387 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:06.274892 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:06.274968 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:06.277024 (+ 2056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:06.277026 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:06.277026 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:06.277033 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:06.278973 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:06.280056 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:06.280057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:06.280057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:06.280121 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:06.280701 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:06.280702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:06.280703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:06.280850 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:06.281043 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:06.281328 (+ 285us) server_negotiation.cc:299] Negotiation successful
0810 21:07:06.281784 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":991,"thread_start_us":72,"threads_started":1}
W20260810 21:07:06.281903 3964 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:42689 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 21:07:06.282114 3964 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:06.282236 3964 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
I20260810 21:07:06.282734 3964 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:06.282850 3964 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
W20260810 21:07:06.283274 3964 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 21:07:06 dist-test-slave-jq4t krb5kdc[1384](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786396026, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:06.901885 3462 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:06.902048 3462 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
I20260810 21:07:06.902513 3102 ts_manager.cc:194] Registered new tserver with Master: 274b613a8aee49dd8cc9c3db70cf9029 (127.15.37.1:33841)
I20260810 21:07:06.903577 3102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:60649
I20260810 21:07:07.107146 3722 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:07.107345 3722 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
I20260810 21:07:07.107718 3102 ts_manager.cc:194] Registered new tserver with Master: e7a27295d79e4e518b7778033f194312 (127.15.37.2:35619)
I20260810 21:07:07.108270 3102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:55641
I20260810 21:07:07.283545 3964 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:07.283726 3964 heartbeater.cc:511] Master 127.15.37.62:42689 requested a full tablet report, sending...
I20260810 21:07:07.284238 3102 ts_manager.cc:194] Registered new tserver with Master: a63bcd84370f4d3b9e1349af64a48a2f (127.15.37.3:45123)
I20260810 21:07:07.284804 3102 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:38751
I20260810 21:07:07.288094 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:07:07.297894 4008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.289276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47626 (local address 127.15.37.62:42689)
0810 21:07:07.289418 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:07.289420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:07.289431 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:07:07.289488 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:07.289489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:07.289501 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:07.289591 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:07.290375 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.291209 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.292296 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.292652 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.292722 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:07.294448 (+ 1726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:07.294450 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:07.294450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:07.294460 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:07.296320 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:07.296781 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:07.296783 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:07.296783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:07.296849 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:07.297053 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:07.297054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:07.297054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:07.297199 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:07.297290 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:07.297694 (+ 404us) server_negotiation.cc:299] Negotiation successful
0810 21:07:07.297783 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":88,"threads_started":1}
I20260810 21:07:07.300316 3102 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47626:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:07:07.302631 3102 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 10 21:07:07 dist-test-slave-jq4t krb5kdc[1384](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396026, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for HTTP/127.15.37.20@KRBTEST.COM
I20260810 21:07:07.333520 4019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.317837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:45123 (local address 127.0.0.1:58740)
0810 21:07:07.323368 (+ 5531us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:07.323431 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:07.323522 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:07.329157 (+ 5635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:07.329158 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:07.329160 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:07.329190 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:07.329191 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.330759 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.330760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:07.332049 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:07.332053 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.333180 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.333180 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:07.333270 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:07.333283 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 21:07:07.333355 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 21:07:07.333418 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5489,"thread_start_us":110,"threads_started":1}
I20260810 21:07:07.334052 4020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.318686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58740 (local address 127.15.37.3:45123)
0810 21:07:07.323267 (+ 4581us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:07.323274 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:07.323744 (+ 470us) server_negotiation.cc:407] Connection header received
0810 21:07:07.323789 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:07.323792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:07.323811 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:07.323884 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:07.329282 (+ 5398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.330468 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.332166 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.332974 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.333062 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:07.333140 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:07.333916 (+ 776us) server_negotiation.cc:299] Negotiation successful
0810 21:07:07.333967 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4528,"thread_start_us":58,"threads_started":1}
I20260810 21:07:07.335119 3833 tablet_service.cc:1467] Processing CreateTablet for tablet 37a227028e7c4f1a8613edaca715eed8 (DEFAULT_TABLE table=test-table [id=0253800aca0648eba2ba8c868f4f55e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:07.335538 3833 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37a227028e7c4f1a8613edaca715eed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:07.338892 4017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.318273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:35619 (local address 127.0.0.1:41976)
0810 21:07:07.330623 (+ 12350us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:07.330637 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:07.330688 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:07.333583 (+ 2895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:07.333583 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:07.333585 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:07.333630 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:07.333632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.335863 (+ 2231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.335864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:07.336943 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:07.336946 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.338605 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.338606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:07.338694 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:07.338700 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 21:07:07.338753 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 21:07:07.338805 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12325,"thread_start_us":88,"threads_started":1}
I20260810 21:07:07.339201 4022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.318978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41976 (local address 127.15.37.2:35619)
0810 21:07:07.332628 (+ 13650us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:07.332634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:07.332648 (+ 14us) server_negotiation.cc:407] Connection header received
0810 21:07:07.332688 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:07.332690 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:07.332709 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:07.332799 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:07.333740 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.334799 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.337067 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.337827 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.337917 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:07.337998 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:07.339063 (+ 1065us) server_negotiation.cc:299] Negotiation successful
0810 21:07:07.339115 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13602,"thread_start_us":59,"threads_started":1}
I20260810 21:07:07.339512 4021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.318833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33660 (local address 127.15.37.1:33841)
0810 21:07:07.328601 (+ 9768us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:07.328608 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:07.328625 (+ 17us) server_negotiation.cc:407] Connection header received
0810 21:07:07.328668 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:07.328671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:07.328689 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:07.328788 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:07.332206 (+ 3418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.333312 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.338058 (+ 4746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.338851 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.338938 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:07.338999 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:07.339380 (+ 381us) server_negotiation.cc:299] Negotiation successful
0810 21:07:07.339432 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9713,"thread_start_us":58,"threads_started":1}
I20260810 21:07:07.339301 4018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.318088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:33841 (local address 127.0.0.1:33660)
0810 21:07:07.323639 (+ 5551us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:07.323648 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:07.323685 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:07.328928 (+ 5243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:07.328933 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:07.328936 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:07.329060 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:07.329063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.333405 (+ 4342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.333406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:07.335760 (+ 2354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:07.335764 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.339054 (+ 3290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.339056 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:07.339124 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:07.339128 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:07:07.339179 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 21:07:07.339226 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5536,"thread_start_us":65,"threads_started":1}
I20260810 21:07:07.340266 3570 tablet_service.cc:1467] Processing CreateTablet for tablet 37a227028e7c4f1a8613edaca715eed8 (DEFAULT_TABLE table=test-table [id=0253800aca0648eba2ba8c868f4f55e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:07.340322 3337 tablet_service.cc:1467] Processing CreateTablet for tablet 37a227028e7c4f1a8613edaca715eed8 (DEFAULT_TABLE table=test-table [id=0253800aca0648eba2ba8c868f4f55e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:07.340696 3570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37a227028e7c4f1a8613edaca715eed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:07.340725 3337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37a227028e7c4f1a8613edaca715eed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:07.344686 4025 tablet_bootstrap.cc:492] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312: Bootstrap starting.
I20260810 21:07:07.345472 4025 tablet_bootstrap.cc:654] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:07.345832 4025 log.cc:824] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:07.346261 4026 tablet_bootstrap.cc:492] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029: Bootstrap starting.
I20260810 21:07:07.346947 4026 tablet_bootstrap.cc:654] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:07.347384 4026 log.cc:824] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:07.348311 4026 tablet_bootstrap.cc:492] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029: No bootstrap required, opened a new log
I20260810 21:07:07.348398 4026 ts_tablet_manager.cc:1397] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:07:07.350875 4026 raft_consensus.cc:348] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63bcd84370f4d3b9e1349af64a48a2f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45123 } } peers { permanent_uuid: "274b613a8aee49dd8cc9c3db70cf9029" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 33841 } } peers { permanent_uuid: "e7a27295d79e4e518b7778033f194312" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35619 } }
I20260810 21:07:07.351100 4026 raft_consensus.cc:374] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:07.351142 4026 raft_consensus.cc:729] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 274b613a8aee49dd8cc9c3db70cf9029, State: Initialized, Role: FOLLOWER
I20260810 21:07:07.351330 4026 consensus_queue.cc:260] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63bcd84370f4d3b9e1349af64a48a2f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45123 } } peers { permanent_uuid: "274b613a8aee49dd8cc9c3db70cf9029" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 33841 } } peers { permanent_uuid: "e7a27295d79e4e518b7778033f194312" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35619 } }
I20260810 21:07:07.351644 4026 ts_tablet_manager.cc:1428] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 21:07:07.351787 3462 heartbeater.cc:503] Master 127.15.37.62:42689 was elected leader, sending a full tablet report...
I20260810 21:07:07.357275 4034 tablet_bootstrap.cc:492] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f: Bootstrap starting.
I20260810 21:07:07.358156 4034 tablet_bootstrap.cc:654] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:07.358500 4034 log.cc:824] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:07.359648 4025 tablet_bootstrap.cc:492] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312: No bootstrap required, opened a new log
I20260810 21:07:07.359752 4025 ts_tablet_manager.cc:1397] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260810 21:07:07.360083 4034 tablet_bootstrap.cc:492] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f: No bootstrap required, opened a new log
I20260810 21:07:07.360231 4034 ts_tablet_manager.cc:1397] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:07:07.362368 4025 raft_consensus.cc:348] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63bcd84370f4d3b9e1349af64a48a2f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45123 } } peers { permanent_uuid: "274b613a8aee49dd8cc9c3db70cf9029" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 33841 } } peers { permanent_uuid: "e7a27295d79e4e518b7778033f194312" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35619 } }
I20260810 21:07:07.362598 4025 raft_consensus.cc:374] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:07.362643 4025 raft_consensus.cc:729] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7a27295d79e4e518b7778033f194312, State: Initialized, Role: FOLLOWER
I20260810 21:07:07.362974 4025 consensus_queue.cc:260] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63bcd84370f4d3b9e1349af64a48a2f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45123 } } peers { permanent_uuid: "274b613a8aee49dd8cc9c3db70cf9029" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 33841 } } peers { permanent_uuid: "e7a27295d79e4e518b7778033f194312" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35619 } }
I20260810 21:07:07.363224 4034 raft_consensus.cc:348] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63bcd84370f4d3b9e1349af64a48a2f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45123 } } peers { permanent_uuid: "274b613a8aee49dd8cc9c3db70cf9029" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 33841 } } peers { permanent_uuid: "e7a27295d79e4e518b7778033f194312" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35619 } }
I20260810 21:07:07.363340 4025 ts_tablet_manager.cc:1428] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 21:07:07.363441 4034 raft_consensus.cc:374] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:07.363474 3722 heartbeater.cc:503] Master 127.15.37.62:42689 was elected leader, sending a full tablet report...
I20260810 21:07:07.363547 4034 raft_consensus.cc:729] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63bcd84370f4d3b9e1349af64a48a2f, State: Initialized, Role: FOLLOWER
I20260810 21:07:07.363721 4034 consensus_queue.cc:260] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63bcd84370f4d3b9e1349af64a48a2f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45123 } } peers { permanent_uuid: "274b613a8aee49dd8cc9c3db70cf9029" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 33841 } } peers { permanent_uuid: "e7a27295d79e4e518b7778033f194312" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35619 } }
I20260810 21:07:07.364068 4034 ts_tablet_manager.cc:1428] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 21:07:07.364373 3964 heartbeater.cc:503] Master 127.15.37.62:42689 was elected leader, sending a full tablet report...
W20260810 21:07:07.381451 3464 tablet.cc:2369] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:07:07.492921 4035 raft_consensus.cc:482] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:07:07.493101 4035 raft_consensus.cc:504] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63bcd84370f4d3b9e1349af64a48a2f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45123 } } peers { permanent_uuid: "274b613a8aee49dd8cc9c3db70cf9029" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 33841 } } peers { permanent_uuid: "e7a27295d79e4e518b7778033f194312" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35619 } }
I20260810 21:07:07.493553 4035 leader_election.cc:288] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a63bcd84370f4d3b9e1349af64a48a2f (127.15.37.3:45123), e7a27295d79e4e518b7778033f194312 (127.15.37.2:35619)
I20260810 21:07:07.498240 4020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.494000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:58829 (local address 127.15.37.3:45123)
0810 21:07:07.494051 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:07.494053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:07.494233 (+ 180us) server_negotiation.cc:407] Connection header received
0810 21:07:07.494333 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:07.494334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:07.494348 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:07.494381 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:07.494669 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.495429 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.497179 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.497782 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.497842 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:07.497850 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:07.498113 (+ 263us) server_negotiation.cc:299] Negotiation successful
0810 21:07:07.498161 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 21:07:07.498240 4022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.494000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:42131 (local address 127.15.37.2:35619)
0810 21:07:07.494051 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:07.494053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:07.494202 (+ 149us) server_negotiation.cc:407] Connection header received
0810 21:07:07.494334 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:07.494335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:07.494348 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:07.494381 (+ 33us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:07.494669 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.495436 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.497178 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.497782 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.497837 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:07.497850 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:07.498113 (+ 263us) server_negotiation.cc:299] Negotiation successful
0810 21:07:07.498160 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 21:07:07.498569 4050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.493738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:35619 (local address 127.15.37.1:42131)
0810 21:07:07.494120 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:07.494132 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:07.494232 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:07.494458 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:07.494459 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:07.494463 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:07.494586 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:07.494588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.495542 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.495542 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:07.497051 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:07.497055 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.497945 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.497946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:07.498018 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:07.498025 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 21:07:07.498409 (+ 384us) client_negotiation.cc:240] Negotiation successful
0810 21:07:07.498470 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":169,"thread_start_us":110,"threads_started":1}
I20260810 21:07:07.498917 4049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.493738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:45123 (local address 127.15.37.1:58829)
0810 21:07:07.494174 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:07.494183 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:07.494256 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:07.494458 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:07.494458 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:07.494460 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:07.494585 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:07.494589 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.495542 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.495542 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:07.497052 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:07.497055 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.497938 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.497939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:07.498018 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:07.498024 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 21:07:07.498785 (+ 761us) client_negotiation.cc:240] Negotiation successful
0810 21:07:07.498843 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"mutex_wait_us":50,"thread_start_us":110,"threads_started":1}
I20260810 21:07:07.498962 3631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37a227028e7c4f1a8613edaca715eed8" candidate_uuid: "274b613a8aee49dd8cc9c3db70cf9029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7a27295d79e4e518b7778033f194312" is_pre_election: true
I20260810 21:07:07.499197 3631 raft_consensus.cc:2454] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 274b613a8aee49dd8cc9c3db70cf9029 in term 0.
I20260810 21:07:07.499259 3863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37a227028e7c4f1a8613edaca715eed8" candidate_uuid: "274b613a8aee49dd8cc9c3db70cf9029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63bcd84370f4d3b9e1349af64a48a2f" is_pre_election: true
I20260810 21:07:07.499423 3863 raft_consensus.cc:2454] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 274b613a8aee49dd8cc9c3db70cf9029 in term 0.
I20260810 21:07:07.499491 3266 leader_election.cc:302] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 274b613a8aee49dd8cc9c3db70cf9029, e7a27295d79e4e518b7778033f194312; no voters:
I20260810 21:07:07.499631 4035 raft_consensus.cc:2781] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:07:07.499675 4035 raft_consensus.cc:482] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:07:07.499701 4035 raft_consensus.cc:3037] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:07.500438 4035 raft_consensus.cc:504] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63bcd84370f4d3b9e1349af64a48a2f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45123 } } peers { permanent_uuid: "274b613a8aee49dd8cc9c3db70cf9029" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 33841 } } peers { permanent_uuid: "e7a27295d79e4e518b7778033f194312" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35619 } }
I20260810 21:07:07.500665 4035 leader_election.cc:288] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [CANDIDATE]: Term 1 election: Requested vote from peers a63bcd84370f4d3b9e1349af64a48a2f (127.15.37.3:45123), e7a27295d79e4e518b7778033f194312 (127.15.37.2:35619)
I20260810 21:07:07.500851 3631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37a227028e7c4f1a8613edaca715eed8" candidate_uuid: "274b613a8aee49dd8cc9c3db70cf9029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7a27295d79e4e518b7778033f194312"
I20260810 21:07:07.500851 3863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37a227028e7c4f1a8613edaca715eed8" candidate_uuid: "274b613a8aee49dd8cc9c3db70cf9029" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63bcd84370f4d3b9e1349af64a48a2f"
I20260810 21:07:07.500931 3631 raft_consensus.cc:3037] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:07.500931 3863 raft_consensus.cc:3037] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:07.501819 3631 raft_consensus.cc:2454] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 274b613a8aee49dd8cc9c3db70cf9029 in term 1.
I20260810 21:07:07.501827 3863 raft_consensus.cc:2454] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 274b613a8aee49dd8cc9c3db70cf9029 in term 1.
I20260810 21:07:07.502022 3266 leader_election.cc:302] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 274b613a8aee49dd8cc9c3db70cf9029, e7a27295d79e4e518b7778033f194312; no voters:
I20260810 21:07:07.502369 4035 raft_consensus.cc:2781] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:07:07.502585 4035 raft_consensus.cc:686] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [term 1 LEADER]: Becoming Leader. State: Replica: 274b613a8aee49dd8cc9c3db70cf9029, State: Running, Role: LEADER
I20260810 21:07:07.502691 4035 consensus_queue.cc:237] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63bcd84370f4d3b9e1349af64a48a2f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45123 } } peers { permanent_uuid: "274b613a8aee49dd8cc9c3db70cf9029" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 33841 } } peers { permanent_uuid: "e7a27295d79e4e518b7778033f194312" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35619 } }
I20260810 21:07:07.503651 3102 catalog_manager.cc:5495] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 reported cstate change: term changed from 0 to 1, leader changed from <none> to 274b613a8aee49dd8cc9c3db70cf9029 (127.15.37.1). New cstate: current_term: 1 leader_uuid: "274b613a8aee49dd8cc9c3db70cf9029" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63bcd84370f4d3b9e1349af64a48a2f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "274b613a8aee49dd8cc9c3db70cf9029" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 33841 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7a27295d79e4e518b7778033f194312" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35619 } health_report { overall_health: UNKNOWN } } }
W20260810 21:07:07.519133 3966 tablet.cc:2369] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:07:07.553576 4021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.550089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33674 (local address 127.15.37.1:33841)
0810 21:07:07.550179 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:07.550181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:07.550191 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:07:07.550238 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:07.550239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:07.550266 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:07.550360 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:07:07.550540 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.551281 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.552529 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:07.552847 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:07.552929 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:07.553134 (+ 205us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:07:07.553306 (+ 172us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:07:07.553435 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:07.553456 (+ 21us) server_negotiation.cc:299] Negotiation successful
0810 21:07:07.553483 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 21:07:07.556126 3631 raft_consensus.cc:1261] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312 [term 1 FOLLOWER]: Refusing update from remote peer 274b613a8aee49dd8cc9c3db70cf9029: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:07:07.556201 3863 raft_consensus.cc:1261] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f [term 1 FOLLOWER]: Refusing update from remote peer 274b613a8aee49dd8cc9c3db70cf9029: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:07:07.556680 4035 consensus_queue.cc:1035] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7a27295d79e4e518b7778033f194312" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 35619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:07:07.556916 4051 consensus_queue.cc:1035] T 37a227028e7c4f1a8613edaca715eed8 P 274b613a8aee49dd8cc9c3db70cf9029 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63bcd84370f4d3b9e1349af64a48a2f" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:07:07.560566 4060 mvcc.cc:205] Tried to move back new op lower bound from 7317078128866947072 to 7317078128651575296. Current Snapshot: MvccSnapshot[applied={T|T < 7317078128866947072}]
I20260810 21:07:07.561870 4064 mvcc.cc:205] Tried to move back new op lower bound from 7317078128866947072 to 7317078128651575296. Current Snapshot: MvccSnapshot[applied={T|T < 7317078128866947072}]
I20260810 21:07:07.565347 3101 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:07:07.565478 3101 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47626:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:07:07.566397 3101 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b50554f35a194938bac6e09e4a65775a: Sending DeleteTablet for 3 replicas of tablet 37a227028e7c4f1a8613edaca715eed8
I20260810 21:07:07.566910 3337 tablet_service.cc:1514] Processing DeleteTablet for tablet 37a227028e7c4f1a8613edaca715eed8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:07 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:33660
I20260810 21:07:07.566998 3833 tablet_service.cc:1514] Processing DeleteTablet for tablet 37a227028e7c4f1a8613edaca715eed8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:07 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:58740
I20260810 21:07:07.567245 3570 tablet_service.cc:1514] Processing DeleteTablet for tablet 37a227028e7c4f1a8613edaca715eed8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:07 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:41976
I20260810 21:07:07.568133 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 3177
I20260810 21:07:07.584738 4084 tablet_replica.cc:330] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f: stopping tablet replica
I20260810 21:07:07.585018 4085 tablet_replica.cc:330] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312: stopping tablet replica
I20260810 21:07:07.585294 4085 raft_consensus.cc:2229] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:07:07.585547 4084 raft_consensus.cc:2229] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:07:07.585991 4085 raft_consensus.cc:2258] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:07:07.586205 4084 raft_consensus.cc:2258] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:07:07.587209 4085 ts_tablet_manager.cc:1905] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 21:07:07.588687 3078 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:33841 (error 108)
I20260810 21:07:07.589564 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 3471
I20260810 21:07:07.589740 4085 ts_tablet_manager.cc:1918] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:07:07.589890 4085 log.cc:1196] T 37a227028e7c4f1a8613edaca715eed8 P e7a27295d79e4e518b7778033f194312: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/37a227028e7c4f1a8613edaca715eed8
I20260810 21:07:07.590507 4084 ts_tablet_manager.cc:1905] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:07:07.592223 4084 ts_tablet_manager.cc:1918] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:07:07.592402 4084 log.cc:1196] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/37a227028e7c4f1a8613edaca715eed8
I20260810 21:07:07.592819 4084 ts_tablet_manager.cc:1939] T 37a227028e7c4f1a8613edaca715eed8 P a63bcd84370f4d3b9e1349af64a48a2f: Deleting consensus metadata
I20260810 21:07:07.597877 3078 catalog_manager.cc:4841] TS a63bcd84370f4d3b9e1349af64a48a2f (127.15.37.3:45123): tablet 37a227028e7c4f1a8613edaca715eed8 (table test-table [id=0253800aca0648eba2ba8c868f4f55e5]) successfully deleted
I20260810 21:07:07.598109 4018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.597807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:33841 (local address 127.0.0.1:33688)
0810 21:07:07.598029 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:07.598078 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:33841: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199}
W20260810 21:07:07.598429 3078 catalog_manager.cc:4584] TS 274b613a8aee49dd8cc9c3db70cf9029 (127.15.37.1:33841): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 37a227028e7c4f1a8613edaca715eed8: Network error: Client connection negotiation failed: client connection to 127.15.37.1:33841: connect: Connection refused (error 111)
I20260810 21:07:07.602284 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 3725
I20260810 21:07:07.630913 4018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:07.630725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:35619 (local address 127.0.0.1:41990)
0810 21:07:07.630793 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:07.630855 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.2:35619: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 21:07:07.637141 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 3047
I20260810 21:07:07.656095 15508 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 21:07:08.004257 15508 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 21:07:08.004369 15508 mini_ranger.cc:66] Stopping Ranger...
I20260810 21:07:08.359803 15508 mini_ranger.cc:68] Stopped Ranger
2026-08-10 21:07:08.360 UTC [1435] LOG: received smart shutdown request
2026-08-10 21:07:08.364 UTC [1435] LOG: background worker "logical replication launcher" (PID 1456) exited with exit code 1
2026-08-10 21:07:08.365 UTC [1447] LOG: shutting down
2026-08-10 21:07:08.543 UTC [1435] LOG: database system is shut down
2026-08-10T21:07:08Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52370 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:07:08 dist-test-slave-jq4t krb5kdc[4108](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:07:08 dist-test-slave-jq4t krb5kdc[4108](info): set up 2 sockets
Aug 10 21:07:08 dist-test-slave-jq4t krb5kdc[4108](info): commencing operation
krb5kdc: starting...
W20260810 21:07:09.956933 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:07:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:07:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:07:10.104682 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:41821
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:45947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:41821,127.15.37.61:37967,127.15.37.60:35291
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:10.191994 4131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:10.192269 4131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:10.192310 4131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:10.193547 4131 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:07:10.193632 4131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:10.193656 4131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:10.193678 4131 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:07:10.193706 4131 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:07:10.195295 4131 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:45947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:41821,127.15.37.61:37967,127.15.37.60:35291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:41821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:10.195602 4131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:10.195864 4131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:10.200977 4137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:10.201004 4141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:10.200989 4138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:10.201205 4131 server_base.cc:1034] running on GCE node
I20260810 21:07:10.201504 4131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:10.201867 4131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:10.203069 4131 hybrid_clock.cc:648] HybridClock initialized: now 1786396030203024 us; error 53 us; skew 500 ppm
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:10.205891 4131 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:07:10.206399 4131 webserver.cc:460] Webserver started at http://127.15.37.62:44367/ using document root <none> and password file <none>
I20260810 21:07:10.206652 4131 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:10.206727 4131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:10.206892 4131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:07:10.208077 4131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "41cccf433df349759f856bb426867470"
format_stamp: "Formatted at 2026-08-10 21:07:10 on dist-test-slave-jq4t"
server_key: "5209ed22af08ba675d816e590df31ae1"
server_key_iv: "e461d5dbd0f562244b8f40b19a20d313"
server_key_version: "encryptionkey@0"
I20260810 21:07:10.208539 4131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "41cccf433df349759f856bb426867470"
format_stamp: "Formatted at 2026-08-10 21:07:10 on dist-test-slave-jq4t"
server_key: "5209ed22af08ba675d816e590df31ae1"
server_key_iv: "e461d5dbd0f562244b8f40b19a20d313"
server_key_version: "encryptionkey@0"
I20260810 21:07:10.210060 4131 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:07:10.210924 4154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:10.211133 4131 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:10.211251 4131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "41cccf433df349759f856bb426867470"
format_stamp: "Formatted at 2026-08-10 21:07:10 on dist-test-slave-jq4t"
server_key: "5209ed22af08ba675d816e590df31ae1"
server_key_iv: "e461d5dbd0f562244b8f40b19a20d313"
server_key_version: "encryptionkey@0"
I20260810 21:07:10.211333 4131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:10.233147 4131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:10.235340 4131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:10.235539 4131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:10.240069 4131 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:41821
I20260810 21:07:10.240110 4251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:41821 every 8 connection(s)
I20260810 21:07:10.240530 4131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:07:10.241259 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 4131
I20260810 21:07:10.241395 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:07:10.241672 15508 external_mini_cluster.cc:1428] Setting key 7823c7088522904d77ab447327d930cb
I20260810 21:07:10.241667 4253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:10.244154 4253 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.15.37.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.61@KRBTEST.COM" created.
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:10.259826 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.245043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:41821 (local address 127.0.0.1:52576)
0810 21:07:10.245226 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.245274 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:10.245818 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:10.246154 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:10.246157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:10.246433 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:10.246607 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.246611 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.248329 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.248330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.249181 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.249184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.249946 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.249947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.250012 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.250680 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:10.250690 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:10.255415 (+ 4725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:10.257971 (+ 2556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.257981 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.257984 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.258281 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.258623 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.258623 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.258624 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.258720 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.259271 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:10.259279 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:10.259352 (+ 73us) client_negotiation.cc:769] Sending connection context
0810 21:07:10.259460 (+ 108us) client_negotiation.cc:240] Negotiation successful
0810 21:07:10.259627 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":97,"threads_started":1}
I20260810 21:07:10.259968 4261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.245265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52576 (local address 127.15.37.62:41821)
0810 21:07:10.245416 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.245422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.245464 (+ 42us) server_negotiation.cc:407] Connection header received
0810 21:07:10.245988 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.245991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.246015 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.246130 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.246717 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.248196 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.249276 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.249842 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.249971 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.255543 (+ 5572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.255556 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.255557 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.255567 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.257847 (+ 2280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.258396 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.258401 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.258401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.258539 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.258794 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.258795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.258796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.259172 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.259269 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.259537 (+ 268us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.259765 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":79,"server-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260810 21:07:10.260862 4253 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:07:10.261301 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.261163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:37967 (local address 127.0.0.1:34482)
0810 21:07:10.261221 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.261276 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:37967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 21:07:10.261502 4157 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.37.61:37967: connect: Connection refused (error 111)
I20260810 21:07:10.262043 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.261942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:37967 (local address 127.0.0.1:34484)
0810 21:07:10.261994 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.262023 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:37967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 21:07:10.262198 4253 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.61:37967: Network error: Client connection negotiation failed: client connection to 127.15.37.61:37967: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.61.keytab.
Entry for principal kudu/127.15.37.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.61.keytab.
I20260810 21:07:10.276693 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.61:37967
--webserver_interface=127.15.37.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.61.keytab
--principal=kudu/127.15.37.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:45947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:41821,127.15.37.61:37967,127.15.37.60:35291
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:07:10.311474 4253 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } attempt: 1
I20260810 21:07:10.312052 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.311894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:37967 (local address 127.0.0.1:34500)
0810 21:07:10.311974 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.312018 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:37967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 21:07:10.312618 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.312412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:37967 (local address 127.0.0.1:34508)
0810 21:07:10.312540 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.312588 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:37967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260810 21:07:10.312744 4253 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.61:37967: Network error: Client connection negotiation failed: client connection to 127.15.37.61:37967: connect: Connection refused (error 111)
W20260810 21:07:10.366310 4268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:10.366597 4268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:10.366640 4268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:10.367883 4268 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:07:10.367966 4268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:10.367990 4268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:10.368010 4268 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:07:10.368049 4268 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:07:10.369781 4268 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:45947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:41821,127.15.37.61:37967,127.15.37.60:35291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.61.keytab
--principal=kudu/127.15.37.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.61:37967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.37.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:10.370096 4268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:10.370353 4268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:10.375556 4278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:10.375581 4286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:10.375563 4280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:10.375876 4268 server_base.cc:1034] running on GCE node
I20260810 21:07:10.376163 4268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:10.376533 4268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:10.377707 4268 hybrid_clock.cc:648] HybridClock initialized: now 1786396030377685 us; error 43 us; skew 500 ppm
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:10.380414 4268 init.cc:377] Logged in from keytab as kudu/127.15.37.61@KRBTEST.COM (short username kudu)
I20260810 21:07:10.380931 4268 webserver.cc:460] Webserver started at http://127.15.37.61:36213/ using document root <none> and password file <none>
I20260810 21:07:10.380894 4253 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } attempt: 2
I20260810 21:07:10.381278 4268 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:10.381356 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.381225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:37967 (local address 127.0.0.1:34524)
0810 21:07:10.381291 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.381327 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:37967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 21:07:10.381381 4268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:10.381560 4268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:07:10.381737 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.381633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:37967 (local address 127.0.0.1:34534)
0810 21:07:10.381679 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.381706 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:37967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260810 21:07:10.381852 4253 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.61:37967: Network error: Client connection negotiation failed: client connection to 127.15.37.61:37967: connect: Connection refused (error 111)
I20260810 21:07:10.382825 4268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/data/instance:
uuid: "6ce32a3ba64c46d185aabda62e117a0a"
format_stamp: "Formatted at 2026-08-10 21:07:10 on dist-test-slave-jq4t"
server_key: "38dcb8290fa01a7407fdbfdf324a8307"
server_key_iv: "4cbbe495fe846eb8736f38364ac89b83"
server_key_version: "encryptionkey@0"
I20260810 21:07:10.383219 4268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/wal/instance:
uuid: "6ce32a3ba64c46d185aabda62e117a0a"
format_stamp: "Formatted at 2026-08-10 21:07:10 on dist-test-slave-jq4t"
server_key: "38dcb8290fa01a7407fdbfdf324a8307"
server_key_iv: "4cbbe495fe846eb8736f38364ac89b83"
server_key_version: "encryptionkey@0"
I20260810 21:07:10.384677 4268 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260810 21:07:10.385464 4299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:10.385649 4268 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:10.385768 4268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/wal
uuid: "6ce32a3ba64c46d185aabda62e117a0a"
format_stamp: "Formatted at 2026-08-10 21:07:10 on dist-test-slave-jq4t"
server_key: "38dcb8290fa01a7407fdbfdf324a8307"
server_key_iv: "4cbbe495fe846eb8736f38364ac89b83"
server_key_version: "encryptionkey@0"
I20260810 21:07:10.385854 4268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:10.398532 4268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:10.400758 4268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:10.400954 4268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:10.405817 4268 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.61:37967
I20260810 21:07:10.405862 4389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.61:37967 every 8 connection(s)
I20260810 21:07:10.406268 4268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/data/info.pb
I20260810 21:07:10.407267 4390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:10.409049 4390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:07:10.413790 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 4268
I20260810 21:07:10.413956 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-1/wal/instance
I20260810 21:07:10.414178 15508 external_mini_cluster.cc:1428] Setting key 12f69203258a305e2dd795f51860a92d
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.61@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:10.419593 4261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.409836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52580 (local address 127.15.37.62:41821)
0810 21:07:10.409943 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.409945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.410143 (+ 198us) server_negotiation.cc:407] Connection header received
0810 21:07:10.410680 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.410682 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.410699 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.410764 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.411493 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.412010 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.413113 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.413334 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.413423 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.416306 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.416309 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.416309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.416319 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.418084 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.418525 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.418526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.418527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.418597 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.418841 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.418842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.418842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.419015 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.419106 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.419391 (+ 285us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.419495 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 21:07:10.419807 4395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.409758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:41821 (local address 127.0.0.1:52580)
0810 21:07:10.410004 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.410049 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:10.410561 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:10.410858 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:10.410862 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:10.411147 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:10.411382 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.411386 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.412126 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.412128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.413018 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.413021 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.413436 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.413438 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.413605 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.414385 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:10.414397 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:10.416192 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:10.418177 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.418186 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.418188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.418444 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.418668 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.418669 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.418669 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.418775 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.419098 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:10.419103 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:10.419238 (+ 135us) client_negotiation.cc:769] Sending connection context
0810 21:07:10.419371 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 21:07:10.419550 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":106,"threads_started":1}
I20260810 21:07:10.420506 4390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.15.37.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.60@KRBTEST.COM" created.
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.61@KRBTEST.COM for kudu/127.15.37.61@KRBTEST.COM
I20260810 21:07:10.431017 4399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.420892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34542 (local address 127.15.37.61:37967)
0810 21:07:10.421072 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.421076 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.421094 (+ 18us) server_negotiation.cc:407] Connection header received
0810 21:07:10.421111 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.421113 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.421124 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.421211 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.421518 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.422230 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.422938 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.423244 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.423336 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.427595 (+ 4259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.427611 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.427611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.427621 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.429550 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.430006 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.430010 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.430010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.430076 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.430303 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.430304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.430304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.430483 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.430555 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.430732 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.430897 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":75,"server-negotiator.queue_time_us":152,"thread_start_us":95,"threads_started":1}
I20260810 21:07:10.431015 4395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.420813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:37967 (local address 127.0.0.1:34542)
0810 21:07:10.420866 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.420879 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:10.420926 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:10.421212 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:10.421212 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:10.421377 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:10.421440 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.421441 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.422327 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.422328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.422843 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.422844 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.423335 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.423336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.423418 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.423955 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:10.423960 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:10.427485 (+ 3525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:10.429655 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.429656 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.429657 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.429892 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.430171 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.430172 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.430173 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.430240 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.430554 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:10.430555 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:10.430613 (+ 58us) client_negotiation.cc:769] Sending connection context
0810 21:07:10.430690 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 21:07:10.430828 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 21:07:10.431854 4390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:07:10.432268 4395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.432124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:35291 (local address 127.0.0.1:44424)
0810 21:07:10.432179 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.432234 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 21:07:10.432442 4304 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
I20260810 21:07:10.432996 4395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.432872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:35291 (local address 127.0.0.1:44440)
0810 21:07:10.432932 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.432967 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 21:07:10.433168 4390 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:35291: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.60.keytab.
Entry for principal kudu/127.15.37.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.60.keytab.
I20260810 21:07:10.445515 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.60:35291
--webserver_interface=127.15.37.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.60.keytab
--principal=kudu/127.15.37.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:45947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:41821,127.15.37.61:37967,127.15.37.60:35291
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:07:10.473002 4253 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } attempt: 3
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for kudu/127.15.37.61@KRBTEST.COM
I20260810 21:07:10.480808 4399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.473571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34558 (local address 127.15.37.61:37967)
0810 21:07:10.473651 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.473653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.473676 (+ 23us) server_negotiation.cc:407] Connection header received
0810 21:07:10.473708 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.473709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.473722 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.473794 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.474201 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.474750 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.475495 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.475736 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.475822 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.478050 (+ 2228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.478051 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.478052 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.478062 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.479536 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.479912 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.479914 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.479914 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.479991 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.480207 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.480208 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.480208 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.480347 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.480426 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.480603 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.480696 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 21:07:10.480808 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.473471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:37967 (local address 127.0.0.1:34558)
0810 21:07:10.473546 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.473558 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:10.473626 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:10.473816 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:10.473818 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:10.474024 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:10.474102 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.474104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.474855 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.474857 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.475395 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.475397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.475819 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.475820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.475922 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.476569 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:10.476574 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:10.477951 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:10.479635 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.479637 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.479637 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.479827 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.480063 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.480064 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.480064 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.480130 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.480428 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:10.480429 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:10.480511 (+ 82us) client_negotiation.cc:769] Sending connection context
0810 21:07:10.480579 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 21:07:10.480695 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 21:07:10.481307 4253 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:07:10.481756 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.481640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:35291 (local address 127.0.0.1:44444)
0810 21:07:10.481698 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.481732 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 21:07:10.482102 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.482015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:35291 (local address 127.0.0.1:44446)
0810 21:07:10.482063 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.482086 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 21:07:10.482193 4253 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:35291: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
I20260810 21:07:10.482399 4390 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } attempt: 1
I20260810 21:07:10.482754 4395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.482636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:35291 (local address 127.0.0.1:44448)
0810 21:07:10.482692 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.482719 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 21:07:10.483094 4395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.482999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:35291 (local address 127.0.0.1:44458)
0810 21:07:10.483045 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.483070 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 21:07:10.483191 4390 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:35291: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
I20260810 21:07:10.513353 4253 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } attempt: 1
I20260810 21:07:10.513881 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.513742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:35291 (local address 127.0.0.1:44472)
0810 21:07:10.513809 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.513851 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260810 21:07:10.514276 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.514178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:35291 (local address 127.0.0.1:44488)
0810 21:07:10.514225 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.514250 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 21:07:10.514393 4253 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:35291: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
W20260810 21:07:10.538161 4404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:10.538450 4404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:10.538491 4404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:10.539701 4404 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:07:10.539777 4404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:10.539801 4404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:10.539822 4404 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:07:10.539853 4404 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:07:10.541631 4404 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:45947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:41821,127.15.37.61:37967,127.15.37.60:35291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.60.keytab
--principal=kudu/127.15.37.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.60:35291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.37.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:10.541945 4404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:10.542204 4404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:10.547531 4412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:10.547541 4409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:10.547597 4404 server_base.cc:1034] running on GCE node
W20260810 21:07:10.547541 4414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:10.548013 4404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:10.548357 4404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:10.549515 4404 hybrid_clock.cc:648] HybridClock initialized: now 1786396030549516 us; error 45 us; skew 500 ppm
I20260810 21:07:10.551333 4390 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } attempt: 2
I20260810 21:07:10.551818 4395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.551649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:35291 (local address 127.0.0.1:44500)
0810 21:07:10.551749 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.551785 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:10.552241 4395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.552133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:35291 (local address 127.0.0.1:44508)
0810 21:07:10.552185 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.552210 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 21:07:10.552338 4390 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:35291: Network error: Client connection negotiation failed: client connection to 127.15.37.60:35291: connect: Connection refused (error 111)
I20260810 21:07:10.552616 4404 init.cc:377] Logged in from keytab as kudu/127.15.37.60@KRBTEST.COM (short username kudu)
I20260810 21:07:10.553088 4404 webserver.cc:460] Webserver started at http://127.15.37.60:34205/ using document root <none> and password file <none>
I20260810 21:07:10.553373 4404 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:10.553447 4404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:10.553591 4404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:07:10.554737 4404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/data/instance:
uuid: "94bfdffb795e4ee88d2dfa3c32705ab4"
format_stamp: "Formatted at 2026-08-10 21:07:10 on dist-test-slave-jq4t"
server_key: "f5fb41a5d5cac42043f9f1a5138301d8"
server_key_iv: "df5611fd989d6de1e078e8710e243122"
server_key_version: "encryptionkey@0"
I20260810 21:07:10.555147 4404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/wal/instance:
uuid: "94bfdffb795e4ee88d2dfa3c32705ab4"
format_stamp: "Formatted at 2026-08-10 21:07:10 on dist-test-slave-jq4t"
server_key: "f5fb41a5d5cac42043f9f1a5138301d8"
server_key_iv: "df5611fd989d6de1e078e8710e243122"
server_key_version: "encryptionkey@0"
I20260810 21:07:10.556632 4404 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:07:10.557446 4422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:10.557628 4404 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:10.557727 4404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/wal
uuid: "94bfdffb795e4ee88d2dfa3c32705ab4"
format_stamp: "Formatted at 2026-08-10 21:07:10 on dist-test-slave-jq4t"
server_key: "f5fb41a5d5cac42043f9f1a5138301d8"
server_key_iv: "df5611fd989d6de1e078e8710e243122"
server_key_version: "encryptionkey@0"
I20260810 21:07:10.557816 4404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:10.577296 4404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:10.579528 4404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:10.579702 4404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:10.584035 4404 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.60:35291
I20260810 21:07:10.584108 4526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.60:35291 every 8 connection(s)
I20260810 21:07:10.584506 4404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/data/info.pb
I20260810 21:07:10.585481 4527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:10.587183 4527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:07:10.589567 4253 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } attempt: 2
I20260810 21:07:10.591881 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 4404
I20260810 21:07:10.592046 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786395855004795-15508-0/minicluster-data/master-2/wal/instance
I20260810 21:07:10.592260 15508 external_mini_cluster.cc:1428] Setting key dfd16b8fffe0ee0a69d3db8f39a92bf2
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.60@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for kudu/127.15.37.60@KRBTEST.COM
I20260810 21:07:10.598906 4261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.588038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52590 (local address 127.15.37.62:41821)
0810 21:07:10.588126 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.588128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.588329 (+ 201us) server_negotiation.cc:407] Connection header received
0810 21:07:10.589059 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.589060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.589076 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.589136 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.589914 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.590638 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.591706 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.592015 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.592084 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.595420 (+ 3336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.595422 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.595422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.595431 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.597206 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.597675 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.597677 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.597677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.597744 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.598067 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.598068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.598068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.598307 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.598404 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.598678 (+ 274us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.598782 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 21:07:10.599079 4535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.590024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44518 (local address 127.15.37.60:35291)
0810 21:07:10.590219 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.590224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.590248 (+ 24us) server_negotiation.cc:407] Connection header received
0810 21:07:10.590271 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.590273 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.590294 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.590372 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.590674 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.591604 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.592567 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.593012 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.593106 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.595325 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.595334 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.595335 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.595342 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.597291 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.597951 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.597954 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.597955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.598008 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.598234 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.598235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.598235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.598524 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.598811 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.598856 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.598927 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":161,"thread_start_us":107,"threads_started":1}
I20260810 21:07:10.599079 4533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.587962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:41821 (local address 127.0.0.1:52590)
0810 21:07:10.588203 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.588240 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:10.588867 (+ 627us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:10.589211 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:10.589215 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:10.589506 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:10.589811 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.589817 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.590743 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.590744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.591603 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.591606 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.592159 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.592160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.592332 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.592992 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:10.593004 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:10.595334 (+ 2330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:10.597292 (+ 1958us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.597299 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.597302 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.597586 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.597814 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.597815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.597816 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.597981 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.598402 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:10.598407 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:10.598513 (+ 106us) client_negotiation.cc:769] Sending connection context
0810 21:07:10.598616 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 21:07:10.598795 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":102,"threads_started":1}
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.60@KRBTEST.COM
I20260810 21:07:10.599673 4527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:07:10.599849 4258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.589943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:35291 (local address 127.0.0.1:44518)
0810 21:07:10.590009 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.590021 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:10.590060 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:10.590397 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:10.590398 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:10.590541 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:10.590579 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.590580 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.591744 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.591745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.592458 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.592462 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.593108 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.593109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.593176 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.593675 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:10.593681 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:10.595224 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:10.597634 (+ 2410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.597635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.597636 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.597863 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.598101 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.598102 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.598103 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.598167 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.598621 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:10.598622 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:10.598668 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 21:07:10.598717 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 21:07:10.599738 (+ 1021us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":917}
I20260810 21:07:10.601991 4253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470: Bootstrap starting.
I20260810 21:07:10.602835 4253 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:10.603176 4253 log.cc:824] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:10.604003 4537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.592705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44522 (local address 127.15.37.60:35291)
0810 21:07:10.592870 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.592872 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.593346 (+ 474us) server_negotiation.cc:407] Connection header received
0810 21:07:10.593369 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.593369 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.593379 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.593469 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.594299 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.595077 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.596072 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.596371 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.596465 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.599901 (+ 3436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.599902 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.599902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.599907 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.602376 (+ 2469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.602834 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.602835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.602836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.602913 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.603151 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.603152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.603152 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.603281 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.603448 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.603788 (+ 340us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.603866 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":88,"threads_started":1}
I20260810 21:07:10.604108 4253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470: No bootstrap required, opened a new log
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.60@KRBTEST.COM for kudu/127.15.37.61@KRBTEST.COM
I20260810 21:07:10.606518 4253 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } }
I20260810 21:07:10.606671 4253 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:10.606707 4253 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41cccf433df349759f856bb426867470, State: Initialized, Role: FOLLOWER
I20260810 21:07:10.606840 4253 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } }
I20260810 21:07:10.607165 4253 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:07:10.607932 4399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.600139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34572 (local address 127.15.37.61:37967)
0810 21:07:10.600188 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.600190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.600294 (+ 104us) server_negotiation.cc:407] Connection header received
0810 21:07:10.600321 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.600322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.600332 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.600377 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.601134 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.601612 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.602633 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.602888 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.602958 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.605126 (+ 2168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.605128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.605128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.605142 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.606664 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.607064 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.607065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.607066 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.607129 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.607353 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.607354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.607354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.607487 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.607529 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.607733 (+ 204us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.607820 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 21:07:10.608278 4533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.600049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:37967 (local address 127.0.0.1:34572)
0810 21:07:10.600187 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.600198 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:10.600245 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:10.600420 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:10.600421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:10.600650 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:10.601061 (+ 411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.601065 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.601697 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.601698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.602545 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.602547 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.603014 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.603015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.603093 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.603511 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:10.603516 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:10.605046 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:10.606774 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.606775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.606776 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.606988 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.607201 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.607202 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.607203 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.607261 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.607569 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:10.607569 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:10.607606 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 21:07:10.608071 (+ 465us) client_negotiation.cc:240] Negotiation successful
0810 21:07:10.608174 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121}
I20260810 21:07:10.608790 4527 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:07:10.609129 4540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } } }
I20260810 21:07:10.610352 4540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [sys.catalog]: This master's current role is: FOLLOWER
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
W20260810 21:07:10.611086 4560 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:07:10.611140 4560 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.60@KRBTEST.COM for kudu/127.15.37.60@KRBTEST.COM
I20260810 21:07:10.611368 4131 master_runner.cc:186] Error getting master registration for 127.15.37.61:37967: OK, instance_id { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" instance_seqno: 1786396030404235 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 21:07:10.615101 4131 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 21:07:10.615433 4261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.605703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52592 (local address 127.15.37.62:41821)
0810 21:07:10.605748 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.605751 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.605758 (+ 7us) server_negotiation.cc:407] Connection header received
0810 21:07:10.605778 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.605778 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.605789 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.605834 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.606514 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.607186 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.608300 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.608659 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.608711 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.611555 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.611557 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.611557 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.611564 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.613664 (+ 2100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.614160 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.614161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.614162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.614222 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.614422 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.614423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.614423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.614629 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.614758 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.615259 (+ 501us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.615343 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 21:07:10.617095 4533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.609119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:35291 (local address 127.0.0.1:44534)
0810 21:07:10.609169 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.609178 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:10.609213 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:10.609339 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:10.609340 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:10.609483 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:10.609515 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.609517 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.610458 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.610460 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.611184 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.611187 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.611611 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.611611 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.611662 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.612514 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:10.612520 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:10.613999 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:10.615950 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.615951 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.615951 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.616148 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.616351 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.616352 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.616352 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.616408 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.616732 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:10.616734 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:10.616775 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 21:07:10.616867 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 21:07:10.616977 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 21:07:10.617144 4537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.609183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44534 (local address 127.15.37.60:35291)
0810 21:07:10.609221 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.609223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.609233 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:07:10.609257 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.609258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.609270 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.609337 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.609574 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.610365 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.611256 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.611529 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.611613 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.614096 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.614097 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.614097 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.614104 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.615844 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.616221 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.616222 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.616222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.616280 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.616458 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.616459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.616460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.616645 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.616730 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.616907 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.617032 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":21}
I20260810 21:07:10.618650 4527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4: Bootstrap starting.
I20260810 21:07:10.619516 4527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:10.619903 4527 log.cc:824] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:10.620994 4527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4: No bootstrap required, opened a new log
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.61@KRBTEST.COM
I20260810 21:07:10.623101 4527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } }
I20260810 21:07:10.623282 4527 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:10.623335 4527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94bfdffb795e4ee88d2dfa3c32705ab4, State: Initialized, Role: FOLLOWER
I20260810 21:07:10.623508 4527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } }
I20260810 21:07:10.623842 4566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } } }
I20260810 21:07:10.623917 4527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:07:10.623984 4566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:07:10.625385 4399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.616211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34588 (local address 127.15.37.61:37967)
0810 21:07:10.616256 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.616257 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.616266 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:07:10.616290 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.616291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.616302 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.616368 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.617000 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.617739 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.618664 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.618971 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.619047 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.622038 (+ 2991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.622040 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.622040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.622051 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.623970 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.624450 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.624451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.624452 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.624551 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.624788 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.624789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.624789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.624947 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.625158 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.625202 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.625288 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 21:07:10.627089 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260810 21:07:10.629317 4585 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:07:10.629381 4585 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:07:10.628893 4404 master_runner.cc:186] Error getting master registration for 127.15.37.61:37967: OK, instance_id { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" instance_seqno: 1786396030404235 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 21:07:10.631289 4404 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 21:07:10.637750 4537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.628704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44540 (local address 127.15.37.60:35291)
0810 21:07:10.628847 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.628878 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.629856 (+ 978us) server_negotiation.cc:407] Connection header received
0810 21:07:10.629960 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.629962 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.629972 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.630001 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.630797 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.631511 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.632394 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.632711 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.632775 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.634488 (+ 1713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.634489 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.634489 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.634497 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.636315 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.636766 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.636767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.636768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.636833 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.637063 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.637064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.637064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.637219 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.637294 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.637529 (+ 235us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.637623 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260810 21:07:10.641124 4399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.629626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34590 (local address 127.15.37.61:37967)
0810 21:07:10.629669 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.629671 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.631625 (+ 1954us) server_negotiation.cc:407] Connection header received
0810 21:07:10.631717 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.631719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.631730 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.631779 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.632499 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.633614 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.634679 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.635310 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.635635 (+ 325us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.637244 (+ 1609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.637245 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.637245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.637253 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.639862 (+ 2609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.640237 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.640239 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.640239 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.640295 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.640516 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.640517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.640517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.640659 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.640735 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.640925 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.641014 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 21:07:10.643488 4390 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } attempt: 3
I20260810 21:07:10.645680 4261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.628654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52598 (local address 127.15.37.62:41821)
0810 21:07:10.628816 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.628818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.638142 (+ 9324us) server_negotiation.cc:407] Connection header received
0810 21:07:10.638268 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.638269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.638286 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.638320 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.638869 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.639635 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.640667 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.640970 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.641015 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.642460 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.642462 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.642462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.642471 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.644304 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.644780 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.644781 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.644782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.644841 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.645056 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.645057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.645057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.645188 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.645283 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.645504 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.645583 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
Aug 10 21:07:10 dist-test-slave-jq4t krb5kdc[4108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396030, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.61@KRBTEST.COM for kudu/127.15.37.60@KRBTEST.COM
I20260810 21:07:10.651520 4395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.643760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:35291 (local address 127.0.0.1:44546)
0810 21:07:10.643810 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:10.643823 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:10.643873 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:10.644620 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:10.644621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:10.644790 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:10.644844 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.644846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.645731 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.645732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.646412 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:10.646415 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.646960 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.646961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:10.647020 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.647519 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:10.647524 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:10.648763 (+ 1239us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:10.650419 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.650421 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.650421 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.650599 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.650824 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:10.650825 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:10.650825 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:10.650888 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:10.651163 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:10.651164 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:10.651235 (+ 71us) client_negotiation.cc:769] Sending connection context
0810 21:07:10.651298 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 21:07:10.651409 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 21:07:10.651527 4537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:10.643827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44546 (local address 127.15.37.60:35291)
0810 21:07:10.644435 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:10.644438 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:10.644447 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:07:10.644470 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:10.644471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:10.644482 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:10.644567 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:10.644931 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.645643 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.646526 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:10.646834 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:10.646899 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:10.648859 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:10.648860 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:10.648861 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:10.648868 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:10.650311 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.650675 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.650677 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.650677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.650739 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:10.650954 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:10.650955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:10.650955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:10.651085 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:10.651158 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:10.651324 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 21:07:10.651409 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578}
I20260810 21:07:10.653709 4390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a: Bootstrap starting.
I20260810 21:07:10.654440 4390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:10.654769 4390 log.cc:824] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:10.655695 4390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a: No bootstrap required, opened a new log
I20260810 21:07:10.657310 4390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } }
I20260810 21:07:10.657454 4390 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:10.657502 4390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ce32a3ba64c46d185aabda62e117a0a, State: Initialized, Role: FOLLOWER
I20260810 21:07:10.657655 4390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } }
I20260810 21:07:10.658010 4390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [sys.catalog]: configured and running, proceeding with master startup.
W20260810 21:07:10.660678 4621 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:07:10.660804 4621 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:07:10.661185 4602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } } }
I20260810 21:07:10.661948 4602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:07:10.662896 4268 master_runner.cc:263] No leader master found from master 6ce32a3ba64c46d185aabda62e117a0a
I20260810 21:07:10.662946 4268 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 21:07:10.664219 4540 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:07:10.664328 4540 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } }
I20260810 21:07:10.664628 4540 leader_election.cc:288] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ce32a3ba64c46d185aabda62e117a0a (127.15.37.61:37967), 94bfdffb795e4ee88d2dfa3c32705ab4 (127.15.37.60:35291)
I20260810 21:07:10.664897 4347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41cccf433df349759f856bb426867470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ce32a3ba64c46d185aabda62e117a0a" is_pre_election: true
I20260810 21:07:10.665072 4347 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41cccf433df349759f856bb426867470 in term 0.
I20260810 21:07:10.665282 4157 leader_election.cc:302] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41cccf433df349759f856bb426867470, 6ce32a3ba64c46d185aabda62e117a0a; no voters:
I20260810 21:07:10.665431 4540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:07:10.665481 4540 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:07:10.665504 4540 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:10.665974 4475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41cccf433df349759f856bb426867470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" is_pre_election: true
I20260810 21:07:10.666146 4475 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41cccf433df349759f856bb426867470 in term 0.
I20260810 21:07:10.666488 4540 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } }
I20260810 21:07:10.666630 4540 leader_election.cc:288] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [CANDIDATE]: Term 1 election: Requested vote from peers 6ce32a3ba64c46d185aabda62e117a0a (127.15.37.61:37967), 94bfdffb795e4ee88d2dfa3c32705ab4 (127.15.37.60:35291)
I20260810 21:07:10.666819 4475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41cccf433df349759f856bb426867470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4"
I20260810 21:07:10.666860 4347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "41cccf433df349759f856bb426867470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ce32a3ba64c46d185aabda62e117a0a"
I20260810 21:07:10.666895 4475 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:10.666940 4347 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:10.667814 4347 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41cccf433df349759f856bb426867470 in term 1.
I20260810 21:07:10.667830 4475 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41cccf433df349759f856bb426867470 in term 1.
I20260810 21:07:10.667996 4157 leader_election.cc:302] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41cccf433df349759f856bb426867470, 6ce32a3ba64c46d185aabda62e117a0a; no voters:
I20260810 21:07:10.668081 4540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:07:10.668239 4540 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [term 1 LEADER]: Becoming Leader. State: Replica: 41cccf433df349759f856bb426867470, State: Running, Role: LEADER
I20260810 21:07:10.668334 4540 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } }
I20260810 21:07:10.668808 4623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41cccf433df349759f856bb426867470. Latest consensus state: current_term: 1 leader_uuid: "41cccf433df349759f856bb426867470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } } }
I20260810 21:07:10.668967 4623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:10.676743 4625 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:07:10.677081 4625 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:07:10.679982 4475 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [term 1 FOLLOWER]: Refusing update from remote peer 41cccf433df349759f856bb426867470: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:07:10.680434 4623 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:07:10.682029 4566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41cccf433df349759f856bb426867470. Latest consensus state: current_term: 1 leader_uuid: "41cccf433df349759f856bb426867470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } } }
I20260810 21:07:10.682137 4566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:07:10.682622 4347 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [term 1 FOLLOWER]: Refusing update from remote peer 41cccf433df349759f856bb426867470: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:07:10.682932 4623 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:07:10.684216 4602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41cccf433df349759f856bb426867470. Latest consensus state: current_term: 1 leader_uuid: "41cccf433df349759f856bb426867470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } } }
I20260810 21:07:10.684321 4602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:07:10.685405 4602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "41cccf433df349759f856bb426867470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } } }
I20260810 21:07:10.685413 4540 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "41cccf433df349759f856bb426867470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } } }
I20260810 21:07:10.685503 4602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:07:10.685519 4540 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:10.685680 4627 mvcc.cc:205] Tried to move back new op lower bound from 7317078141661728768 to 7317078141618085888. Current Snapshot: MvccSnapshot[applied={T|T < 7317078141661728768}]
I20260810 21:07:10.686154 4631 mvcc.cc:205] Tried to move back new op lower bound from 7317078141661728768 to 7317078141618085888. Current Snapshot: MvccSnapshot[applied={T|T < 7317078141661728768}]
I20260810 21:07:10.686491 4625 catalog_manager.cc:1347] Generated new cluster ID: eba7920792d242058bd01e95dbd6fcde
I20260810 21:07:10.686547 4625 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:07:10.693446 4623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "41cccf433df349759f856bb426867470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } } }
I20260810 21:07:10.693586 4623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470 [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:10.694185 4566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "41cccf433df349759f856bb426867470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cccf433df349759f856bb426867470" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41821 } } peers { permanent_uuid: "6ce32a3ba64c46d185aabda62e117a0a" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 37967 } } peers { permanent_uuid: "94bfdffb795e4ee88d2dfa3c32705ab4" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 35291 } } }
I20260810 21:07:10.694296 4566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:07:10.700724 4628 mvcc.cc:205] Tried to move back new op lower bound from 7317078141661728768 to 7317078141618085888. Current Snapshot: MvccSnapshot[applied={T|T < 7317078141661728768}]
I20260810 21:07:10.709439 4625 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:07:10.710254 4625 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:07:10.720182 4625 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 41cccf433df349759f856bb426867470: Generated new TSK 0
I20260810 21:07:10.720417 4625 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:07:11.629906 4585 catalog_manager.cc:1259] Loaded cluster ID: eba7920792d242058bd01e95dbd6fcde
I20260810 21:07:11.630000 4585 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4: loading cluster ID for follower catalog manager: success
I20260810 21:07:11.630905 4585 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4: acquiring CA information for follower catalog manager: success
I20260810 21:07:11.631249 4585 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 94bfdffb795e4ee88d2dfa3c32705ab4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 21:07:11.661361 4621 catalog_manager.cc:1259] Loaded cluster ID: eba7920792d242058bd01e95dbd6fcde
I20260810 21:07:11.661455 4621 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a: loading cluster ID for follower catalog manager: success
I20260810 21:07:11.662366 4621 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a: acquiring CA information for follower catalog manager: success
I20260810 21:07:11.662755 4621 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6ce32a3ba64c46d185aabda62e117a0a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 21:07:11.784462 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 4131
I20260810 21:07:11.802412 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 4268
I20260810 21:07:11.815233 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 4404
2026-08-10T21:07:11Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3158 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:07:11 dist-test-slave-jq4t krb5kdc[4648](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:07:11 dist-test-slave-jq4t krb5kdc[4648](info): set up 2 sockets
Aug 10 21:07:11 dist-test-slave-jq4t krb5kdc[4648](info): commencing operation
krb5kdc: starting...
W20260810 21:07:13.107741 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:07:13 dist-test-slave-jq4t krb5kdc[4648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:07:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:07:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:07:13.244004 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39087
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:40857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:39087
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:13.332309 4670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:13.332646 4670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:13.332697 4670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:13.333902 4670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:07:13.333994 4670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:13.334020 4670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:13.334043 4670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:07:13.334069 4670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:07:13.335701 4670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:40857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:39087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:13.336027 4670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:13.336293 4670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:13.341585 4690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:13.341840 4670 server_base.cc:1034] running on GCE node
W20260810 21:07:13.341595 4680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:13.341598 4683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:13.342254 4670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:13.342543 4670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:13.343695 4670 hybrid_clock.cc:648] HybridClock initialized: now 1786396033343685 us; error 31 us; skew 500 ppm
Aug 10 21:07:13 dist-test-slave-jq4t krb5kdc[4648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396033, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:13.346390 4670 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:07:13.346886 4670 webserver.cc:460] Webserver started at http://127.15.37.62:40817/ using document root <none> and password file <none>
I20260810 21:07:13.347158 4670 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:13.347235 4670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:13.347402 4670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:07:13.348599 4670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "ce5a8c8743264eb297c27b716e134bdf"
format_stamp: "Formatted at 2026-08-10 21:07:13 on dist-test-slave-jq4t"
server_key: "5be06ee6fae1100a82473ee6d686aebc"
server_key_iv: "8109f8247723d78964553655c50acdf3"
server_key_version: "encryptionkey@0"
I20260810 21:07:13.348975 4670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "ce5a8c8743264eb297c27b716e134bdf"
format_stamp: "Formatted at 2026-08-10 21:07:13 on dist-test-slave-jq4t"
server_key: "5be06ee6fae1100a82473ee6d686aebc"
server_key_iv: "8109f8247723d78964553655c50acdf3"
server_key_version: "encryptionkey@0"
I20260810 21:07:13.350446 4670 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 21:07:13.351325 4710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:13.351558 4670 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:07:13.351675 4670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "ce5a8c8743264eb297c27b716e134bdf"
format_stamp: "Formatted at 2026-08-10 21:07:13 on dist-test-slave-jq4t"
server_key: "5be06ee6fae1100a82473ee6d686aebc"
server_key_iv: "8109f8247723d78964553655c50acdf3"
server_key_version: "encryptionkey@0"
I20260810 21:07:13.351758 4670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:13.399096 4670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:13.401872 4670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:13.402084 4670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:13.406505 4670 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:39087
I20260810 21:07:13.406548 4807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:39087 every 8 connection(s)
I20260810 21:07:13.406951 4670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:07:13.407928 4810 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:13.410451 4810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf: Bootstrap starting.
I20260810 21:07:13.411046 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 4670
I20260810 21:07:13.411165 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:07:13.411314 4810 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:13.411393 15508 external_mini_cluster.cc:1428] Setting key 71ca44ccd0cb3a20a86d14ccfcac8496
I20260810 21:07:13.411669 4810 log.cc:824] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:13.412631 4810 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf: No bootstrap required, opened a new log
I20260810 21:07:13.415163 4810 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5a8c8743264eb297c27b716e134bdf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39087 } }
I20260810 21:07:13.415354 4810 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:13.415390 4810 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce5a8c8743264eb297c27b716e134bdf, State: Initialized, Role: FOLLOWER
I20260810 21:07:13.415551 4810 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5a8c8743264eb297c27b716e134bdf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39087 } }
I20260810 21:07:13.415653 4810 raft_consensus.cc:388] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:07:13.415688 4810 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:07:13.415728 4810 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:13.416575 4810 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5a8c8743264eb297c27b716e134bdf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39087 } }
I20260810 21:07:13.416697 4810 leader_election.cc:302] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ce5a8c8743264eb297c27b716e134bdf; no voters:
I20260810 21:07:13.416929 4810 leader_election.cc:288] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:07:13.417007 4818 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:07:13.417179 4818 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [term 1 LEADER]: Becoming Leader. State: Replica: ce5a8c8743264eb297c27b716e134bdf, State: Running, Role: LEADER
I20260810 21:07:13.417270 4810 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:07:13.417351 4818 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5a8c8743264eb297c27b716e134bdf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39087 } }
I20260810 21:07:13.417809 4818 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce5a8c8743264eb297c27b716e134bdf. Latest consensus state: current_term: 1 leader_uuid: "ce5a8c8743264eb297c27b716e134bdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5a8c8743264eb297c27b716e134bdf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39087 } } }
I20260810 21:07:13.417951 4818 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:13.419181 4821 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ce5a8c8743264eb297c27b716e134bdf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ce5a8c8743264eb297c27b716e134bdf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39087 } } }
I20260810 21:07:13.419275 4821 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:13.419437 4825 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 10 21:07:13 dist-test-slave-jq4t krb5kdc[4648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:13.420094 4825 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:07:13.422173 4825 catalog_manager.cc:1347] Generated new cluster ID: 36414403ce7a4c9883c46b7ad9924cf4
I20260810 21:07:13.422230 4825 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:07:13.425114 4816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:13.411999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55148 (local address 127.15.37.62:39087)
0810 21:07:13.412186 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:13.412193 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:13.412251 (+ 58us) server_negotiation.cc:407] Connection header received
0810 21:07:13.412940 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:13.412949 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:13.413016 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:13.413181 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:13.413835 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:13.415373 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:13.416589 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:13.417384 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:13.417891 (+ 507us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:13.420549 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:13.420553 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:13.420554 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:13.420568 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:13.422896 (+ 2328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:13.423341 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:13.423345 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:13.423346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:13.423472 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:13.423690 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:13.423691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:13.423692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:13.424018 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:13.424636 (+ 618us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:13.424731 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 21:07:13.424884 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":75,"threads_started":1}
I20260810 21:07:13.426112 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:07:13.445814 4825 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:07:13.446614 4825 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:07:13.455235 4825 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ce5a8c8743264eb297c27b716e134bdf: Generated new TSK 0
I20260810 21:07:13.455580 4825 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:07:13.480789 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 4670
2026-08-10T21:07:13Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1660 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:07:13 dist-test-slave-jq4t krb5kdc[4858](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:07:13 dist-test-slave-jq4t krb5kdc[4858](info): set up 2 sockets
Aug 10 21:07:13 dist-test-slave-jq4t krb5kdc[4858](info): commencing operation
krb5kdc: starting...
W20260810 21:07:14.752772 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.244s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:07:14 dist-test-slave-jq4t krb5kdc[4858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:07:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:07:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:07:14.892597 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:46557
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:46557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:14.981369 4882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:14.981602 4882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:14.981627 4882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:14.982854 4882 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:07:14.982903 4882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:14.982918 4882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:14.982931 4882 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:07:14.982944 4882 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:07:14.984622 4882 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:46557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:46557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:14.984937 4882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:14.985215 4882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:14.990712 4902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:14.990729 4892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:14.990722 4896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:14.990904 4882 server_base.cc:1034] running on GCE node
I20260810 21:07:14.991322 4882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:14.991693 4882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:14.992851 4882 hybrid_clock.cc:648] HybridClock initialized: now 1786396034992837 us; error 37 us; skew 500 ppm
Aug 10 21:07:14 dist-test-slave-jq4t krb5kdc[4858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396034, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:15.002562 4882 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:07:15.003201 4882 webserver.cc:460] Webserver started at http://127.15.37.62:35045/ using document root <none> and password file <none>
I20260810 21:07:15.003512 4882 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:15.003598 4882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:15.003772 4882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:07:15.005182 4882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "57010f8133df48ffa7326a1bb5c8aefb"
format_stamp: "Formatted at 2026-08-10 21:07:14 on dist-test-slave-jq4t"
server_key: "93cf98ff6c4aba726322abb40c9de93f"
server_key_iv: "7c9d6c098e8973dce7d47acc35202a83"
server_key_version: "encryptionkey@0"
I20260810 21:07:15.005599 4882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "57010f8133df48ffa7326a1bb5c8aefb"
format_stamp: "Formatted at 2026-08-10 21:07:14 on dist-test-slave-jq4t"
server_key: "93cf98ff6c4aba726322abb40c9de93f"
server_key_iv: "7c9d6c098e8973dce7d47acc35202a83"
server_key_version: "encryptionkey@0"
I20260810 21:07:15.007153 4882 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:07:15.008031 4918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:15.008278 4882 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:15.008371 4882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "57010f8133df48ffa7326a1bb5c8aefb"
format_stamp: "Formatted at 2026-08-10 21:07:14 on dist-test-slave-jq4t"
server_key: "93cf98ff6c4aba726322abb40c9de93f"
server_key_iv: "7c9d6c098e8973dce7d47acc35202a83"
server_key_version: "encryptionkey@0"
I20260810 21:07:15.008497 4882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:15.022639 4882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:15.025010 4882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:15.025185 4882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:15.029692 4882 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:46557
I20260810 21:07:15.029826 5041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:46557 every 8 connection(s)
I20260810 21:07:15.030193 4882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:07:15.031342 5044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:15.033944 5044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Bootstrap starting.
I20260810 21:07:15.034631 5044 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:15.034953 5044 log.cc:824] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:15.035753 5044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: No bootstrap required, opened a new log
I20260810 21:07:15.037506 5044 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } }
I20260810 21:07:15.037693 5044 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:15.037750 5044 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57010f8133df48ffa7326a1bb5c8aefb, State: Initialized, Role: FOLLOWER
I20260810 21:07:15.037927 5044 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } }
I20260810 21:07:15.038039 5044 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:07:15.038089 5044 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:07:15.038147 5044 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:15.039094 5044 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } }
I20260810 21:07:15.039237 5044 leader_election.cc:302] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57010f8133df48ffa7326a1bb5c8aefb; no voters:
I20260810 21:07:15.039455 5044 leader_election.cc:288] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:07:15.039496 5050 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:07:15.039706 5050 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 1 LEADER]: Becoming Leader. State: Replica: 57010f8133df48ffa7326a1bb5c8aefb, State: Running, Role: LEADER
I20260810 21:07:15.039757 5044 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:07:15.039809 5050 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } }
I20260810 21:07:15.040156 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 4882
I20260810 21:07:15.040294 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:07:15.040582 15508 external_mini_cluster.cc:1428] Setting key b9e5b2d5466090584908819e26b7c315
I20260810 21:07:15.041071 5054 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57010f8133df48ffa7326a1bb5c8aefb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } } }
I20260810 21:07:15.041198 5054 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:15.041070 5055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57010f8133df48ffa7326a1bb5c8aefb. Latest consensus state: current_term: 1 leader_uuid: "57010f8133df48ffa7326a1bb5c8aefb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } } }
I20260810 21:07:15.041293 5055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:15.041438 5087 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:07:15.042155 5087 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:07:15.043802 5087 catalog_manager.cc:1347] Generated new cluster ID: 265713884a9b4f1e9707afeb1d444def
I20260810 21:07:15.043862 5087 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:07:15 dist-test-slave-jq4t krb5kdc[4858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:15.051704 5088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.041367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35864 (local address 127.15.37.62:46557)
0810 21:07:15.041527 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:15.041540 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:15.041700 (+ 160us) server_negotiation.cc:407] Connection header received
0810 21:07:15.041852 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:15.041858 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:15.041905 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:15.042069 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:15.042787 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.043971 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.044878 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.045372 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.045506 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.048019 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:15.048024 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:15.048025 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:15.048043 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:15.049911 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:15.050317 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:15.050321 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:15.050321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:15.050457 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:15.050701 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:15.050701 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:15.050702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:15.051012 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:15.051210 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:15.051291 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 21:07:15.051473 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":71,"threads_started":1}
I20260810 21:07:15.055811 5087 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:07:15.056421 5087 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:07:15.066602 5087 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Generated new TSK 0
I20260810 21:07:15.066869 5087 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:07:15.105427 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:46557
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:15.196614 5096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:15.196849 5096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:15.196877 5096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:15.198055 5096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:15.198100 5096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:15.198128 5096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:07:15.199613 5096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:46557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:15.199834 5096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:15.200047 5096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:15.206054 5119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:15.206048 5107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:15.206048 5109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:15.206350 5096 server_base.cc:1034] running on GCE node
I20260810 21:07:15.206629 5096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:15.206921 5096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:15.208108 5096 hybrid_clock.cc:648] HybridClock initialized: now 1786396035208110 us; error 47 us; skew 500 ppm
Aug 10 21:07:15 dist-test-slave-jq4t krb5kdc[4858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396035, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:15.210942 5096 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:07:15.211464 5096 webserver.cc:460] Webserver started at http://127.15.37.1:36757/ using document root <none> and password file <none>
I20260810 21:07:15.211771 5096 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:15.211822 5096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:15.211927 5096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:07:15.213176 5096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "8f0501720b15477591af1ff9b787213a"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "ceb1085c416e42479f75ce960669d178"
server_key_iv: "4b0a4fd65e2289dbfb323b66e15d619b"
server_key_version: "encryptionkey@0"
I20260810 21:07:15.213510 5096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "8f0501720b15477591af1ff9b787213a"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "ceb1085c416e42479f75ce960669d178"
server_key_iv: "4b0a4fd65e2289dbfb323b66e15d619b"
server_key_version: "encryptionkey@0"
I20260810 21:07:15.214917 5096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 21:07:15.215703 5128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:15.215888 5096 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:15.215968 5096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "8f0501720b15477591af1ff9b787213a"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "ceb1085c416e42479f75ce960669d178"
server_key_iv: "4b0a4fd65e2289dbfb323b66e15d619b"
server_key_version: "encryptionkey@0"
I20260810 21:07:15.216034 5096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:15.224257 5096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:15.226423 5096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:15.226547 5096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:15.226750 5096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:15.227133 5096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:15.227169 5096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:15.227193 5096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:15.227249 5096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:15.233745 5096 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:36491
I20260810 21:07:15.233798 5344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:36491 every 8 connection(s)
I20260810 21:07:15.234155 5096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
Aug 10 21:07:15 dist-test-slave-jq4t krb5kdc[4858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396035, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:15.242349 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 5096
I20260810 21:07:15.242494 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:07:15.242762 15508 external_mini_cluster.cc:1428] Setting key e49b22766b44686db55fe4bc2c43fb52
I20260810 21:07:15.245126 5350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.234920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:33951)
0810 21:07:15.235146 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:15.235194 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:15.235749 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:15.236044 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:15.236048 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:15.236709 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:15.236936 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.236942 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.237739 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.237741 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.238594 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.238596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.239038 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.239039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.239184 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.239900 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:15.239909 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:15.241537 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:15.243513 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:15.243524 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:15.243528 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:15.243817 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:15.244059 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:15.244059 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:15.244060 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:15.244174 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:15.244535 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:15.244542 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:15.244695 (+ 153us) client_negotiation.cc:769] Sending connection context
0810 21:07:15.244787 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 21:07:15.244929 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":107,"threads_started":1}
I20260810 21:07:15.245117 5088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.234977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:33951 (local address 127.15.37.62:46557)
0810 21:07:15.235074 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:15.235076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:15.235292 (+ 216us) server_negotiation.cc:407] Connection header received
0810 21:07:15.235871 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:15.235873 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:15.235890 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:15.235954 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:15.237063 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.237612 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.238715 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.238938 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.239028 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.241663 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:15.241665 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:15.241666 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:15.241675 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:15.243417 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:15.243907 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:15.243909 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:15.243909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:15.243977 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:15.244244 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:15.244245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:15.244246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:15.244415 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:15.244532 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:15.244864 (+ 332us) server_negotiation.cc:299] Negotiation successful
0810 21:07:15.244972 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 21:07:15.245785 5348 heartbeater.cc:347] Connected to a master server at 127.15.37.62:46557
I20260810 21:07:15.245924 5348 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:15.246157 5348 heartbeater.cc:511] Master 127.15.37.62:46557 requested a full tablet report, sending...
I20260810 21:07:15.246755 4953 ts_manager.cc:194] Registered new tserver with Master: 8f0501720b15477591af1ff9b787213a (127.15.37.1:36491)
I20260810 21:07:15.247447 4953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:33951
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:07:15.273742 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:46557
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:15.363222 5354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:15.363462 5354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:15.363488 5354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:15.364763 5354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:15.364815 5354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:15.364845 5354 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:07:15.366475 5354 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:46557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:15.366797 5354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:15.367101 5354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:15.372987 5364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:15.373067 5362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:15.373036 5354 server_base.cc:1034] running on GCE node
W20260810 21:07:15.373289 5361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:15.373554 5354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:15.373886 5354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:15.375108 5354 hybrid_clock.cc:648] HybridClock initialized: now 1786396035375083 us; error 62 us; skew 500 ppm
Aug 10 21:07:15 dist-test-slave-jq4t krb5kdc[4858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396035, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:15.378249 5354 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:07:15.378775 5354 webserver.cc:460] Webserver started at http://127.15.37.2:39371/ using document root <none> and password file <none>
I20260810 21:07:15.379061 5354 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:15.379146 5354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:15.379333 5354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:07:15.380669 5354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "63f8af48bf1a43a9a12865910ef55180"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "07a1c03a4b4cf2b0811609411c2b5822"
server_key_iv: "d64dc158185f043e7e37ed1cf9bbff73"
server_key_version: "encryptionkey@0"
I20260810 21:07:15.381089 5354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "63f8af48bf1a43a9a12865910ef55180"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "07a1c03a4b4cf2b0811609411c2b5822"
server_key_iv: "d64dc158185f043e7e37ed1cf9bbff73"
server_key_version: "encryptionkey@0"
I20260810 21:07:15.382797 5354 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:15.384048 5384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:15.384575 5354 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:15.384687 5354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "63f8af48bf1a43a9a12865910ef55180"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "07a1c03a4b4cf2b0811609411c2b5822"
server_key_iv: "d64dc158185f043e7e37ed1cf9bbff73"
server_key_version: "encryptionkey@0"
I20260810 21:07:15.384783 5354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:15.410149 5354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:15.413280 5354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:15.413496 5354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:15.413826 5354 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:15.414225 5354 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:15.414292 5354 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:15.414337 5354 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:15.414368 5354 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:15.421422 5354 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:38793
I20260810 21:07:15.421536 5606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:38793 every 8 connection(s)
I20260810 21:07:15.421928 5354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
Aug 10 21:07:15 dist-test-slave-jq4t krb5kdc[4858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396035, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:15.431015 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 5354
I20260810 21:07:15.431164 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:07:15.431418 15508 external_mini_cluster.cc:1428] Setting key 2d8bea106166d89aab3c236b36017208
I20260810 21:07:15.433946 5088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.422882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:51271 (local address 127.15.37.62:46557)
0810 21:07:15.422982 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:15.422984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:15.423165 (+ 181us) server_negotiation.cc:407] Connection header received
0810 21:07:15.423738 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:15.423740 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:15.423752 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:15.423832 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:15.425596 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.426162 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.427381 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.427595 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.427664 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.430231 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:15.430233 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:15.430233 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:15.430242 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:15.432011 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:15.432782 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:15.432784 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:15.432784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:15.432856 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:15.433182 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:15.433183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:15.433183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:15.433323 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:15.433412 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:15.433746 (+ 334us) server_negotiation.cc:299] Negotiation successful
0810 21:07:15.433848 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260810 21:07:15.434244 5611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.422828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:51271)
0810 21:07:15.423018 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:15.423066 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:15.423602 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:15.424103 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:15.424111 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:15.425186 (+ 1075us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:15.425432 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.425443 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.426317 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.426319 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.427255 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.427258 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.427710 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.427711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.427847 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.428566 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:15.428577 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:15.430092 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:15.432299 (+ 2207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:15.432312 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:15.432315 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:15.432676 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:15.432940 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:15.432941 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:15.432941 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:15.433098 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:15.433403 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:15.433411 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:15.433590 (+ 179us) client_negotiation.cc:769] Sending connection context
0810 21:07:15.433710 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 21:07:15.433903 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":104,"threads_started":1}
I20260810 21:07:15.434960 5609 heartbeater.cc:347] Connected to a master server at 127.15.37.62:46557
I20260810 21:07:15.435096 5609 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:15.435338 5609 heartbeater.cc:511] Master 127.15.37.62:46557 requested a full tablet report, sending...
I20260810 21:07:15.435858 4953 ts_manager.cc:194] Registered new tserver with Master: 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793)
I20260810 21:07:15.436331 4953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:51271
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:07:15.465166 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:46557
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:15.557492 5614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:15.557766 5614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:15.557808 5614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:15.559026 5614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:15.559114 5614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:15.559163 5614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:07:15.560882 5614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:46557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:15.561193 5614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:15.561455 5614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:15.567044 5626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:15.567203 5614 server_base.cc:1034] running on GCE node
W20260810 21:07:15.567040 5623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:15.567056 5624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:15.567510 5614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:15.567745 5614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:15.568928 5614 hybrid_clock.cc:648] HybridClock initialized: now 1786396035568924 us; error 56 us; skew 500 ppm
Aug 10 21:07:15 dist-test-slave-jq4t krb5kdc[4858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396035, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:15.571785 5614 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:07:15.572293 5614 webserver.cc:460] Webserver started at http://127.15.37.3:45217/ using document root <none> and password file <none>
I20260810 21:07:15.572587 5614 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:15.572638 5614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:15.572738 5614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:07:15.573796 5614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "efacecdf73c64b9da9317b726abbee2e"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "86434c52b6c0448accdd8f4669eec549"
server_key_iv: "6dfb4f9f551dc0f87c4637d93925d7b9"
server_key_version: "encryptionkey@0"
I20260810 21:07:15.574121 5614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "efacecdf73c64b9da9317b726abbee2e"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "86434c52b6c0448accdd8f4669eec549"
server_key_iv: "6dfb4f9f551dc0f87c4637d93925d7b9"
server_key_version: "encryptionkey@0"
I20260810 21:07:15.575507 5614 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:07:15.576352 5634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:15.576610 5614 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:07:15.576689 5614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "efacecdf73c64b9da9317b726abbee2e"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "86434c52b6c0448accdd8f4669eec549"
server_key_iv: "6dfb4f9f551dc0f87c4637d93925d7b9"
server_key_version: "encryptionkey@0"
I20260810 21:07:15.576798 5614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:15.584353 5614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:15.586877 5614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:15.587039 5614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:15.587344 5614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:15.587664 5614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:15.587697 5614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:15.587721 5614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:15.587733 5614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:15.594678 5614 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:42575
I20260810 21:07:15.594724 5847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:42575 every 8 connection(s)
I20260810 21:07:15.595088 5614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
Aug 10 21:07:15 dist-test-slave-jq4t krb5kdc[4858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396035, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:15.602036 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 5614
I20260810 21:07:15.602160 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:07:15.602367 15508 external_mini_cluster.cc:1428] Setting key ac6966789cea6ea0e6f7a56c43c4ef63
I20260810 21:07:15.605618 5088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.595898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:35453 (local address 127.15.37.62:46557)
0810 21:07:15.595978 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:15.595980 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:15.596188 (+ 208us) server_negotiation.cc:407] Connection header received
0810 21:07:15.596825 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:15.596826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:15.596836 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:15.596900 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:15.597911 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.598409 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.599420 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.599615 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.599667 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.602239 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:15.602241 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:15.602242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:15.602253 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:15.604120 (+ 1867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:15.604615 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:15.604615 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:15.604616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:15.604677 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:15.604979 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:15.604980 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:15.604980 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:15.605125 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:15.605193 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:15.605467 (+ 274us) server_negotiation.cc:299] Negotiation successful
0810 21:07:15.605546 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 21:07:15.605823 5851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.595853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:35453)
0810 21:07:15.596048 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:15.596094 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:15.596726 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:15.596971 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:15.596975 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:15.597608 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:15.597824 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.597829 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.598509 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.598509 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.599336 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.599338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.599698 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.599699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.599806 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.600363 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:15.600371 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:15.602038 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:15.604199 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:15.604207 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:15.604210 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:15.604467 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:15.604740 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:15.604741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:15.604741 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:15.604858 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:15.605192 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:15.605197 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:15.605334 (+ 137us) client_negotiation.cc:769] Sending connection context
0810 21:07:15.605414 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 21:07:15.605566 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":97,"threads_started":1}
I20260810 21:07:15.606393 5849 heartbeater.cc:347] Connected to a master server at 127.15.37.62:46557
I20260810 21:07:15.606525 5849 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:15.606742 5849 heartbeater.cc:511] Master 127.15.37.62:46557 requested a full tablet report, sending...
I20260810 21:07:15.607170 4953 ts_manager.cc:194] Registered new tserver with Master: efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575)
I20260810 21:07:15.607585 4953 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:35453
I20260810 21:07:15.615182 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:07:15.623560 5088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.616848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34238 (local address 127.15.37.62:46557)
0810 21:07:15.616907 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:15.616909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:15.616935 (+ 26us) server_negotiation.cc:407] Connection header received
0810 21:07:15.617032 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:15.617033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:15.617046 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:15.617122 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:15.617764 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.618282 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.619103 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.619300 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.619395 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.620917 (+ 1522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:15.620918 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:15.620918 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:15.620927 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:15.622225 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:15.622625 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:15.622626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:15.622626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:15.622690 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:15.622914 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:15.622915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:15.622915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:15.623092 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:15.623214 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:15.623349 (+ 135us) server_negotiation.cc:299] Negotiation successful
0810 21:07:15.623433 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 21:07:15.625322 4953 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34238:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:07:15.627360 4953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:07:15.634728 5872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.630347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33142 (local address 127.15.37.1:36491)
0810 21:07:15.630605 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:15.630611 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:15.630621 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:07:15.630663 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:15.630665 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:15.630680 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:15.630781 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:15.631030 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.631989 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.633457 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.634228 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.634308 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.634371 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:15.634570 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 21:07:15.634617 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":96,"threads_started":1}
I20260810 21:07:15.634737 5875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.630233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:38793 (local address 127.0.0.1:46734)
0810 21:07:15.630587 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:15.630600 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:15.630662 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:15.631002 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:15.631003 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:15.631005 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:15.631123 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.631125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.632563 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.632564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.633649 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.633652 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.634442 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.634443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.634514 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.634519 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:07:15.634584 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 21:07:15.634631 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":108,"threads_started":1}
I20260810 21:07:15.634742 5869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.630172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:36491 (local address 127.0.0.1:33142)
0810 21:07:15.630421 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:15.630468 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:15.630541 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:15.630810 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:15.630831 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:15.630833 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:15.630915 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.630919 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.632112 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.632113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.633352 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.633355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.634342 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.634343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.634447 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.634464 (+ 17us) client_negotiation.cc:769] Sending connection context
0810 21:07:15.634546 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 21:07:15.634608 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":101,"threads_started":1}
I20260810 21:07:15.635006 5879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.630646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34750 (local address 127.15.37.3:42575)
0810 21:07:15.630978 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:15.630982 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:15.631191 (+ 209us) server_negotiation.cc:407] Connection header received
0810 21:07:15.631304 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:15.631307 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:15.631324 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:15.631410 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:15.631556 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.632611 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.633806 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.634544 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.634604 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.634657 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:15.634868 (+ 211us) server_negotiation.cc:299] Negotiation successful
0810 21:07:15.634920 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":125,"threads_started":1}
I20260810 21:07:15.635140 5873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.630383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46734 (local address 127.15.37.2:38793)
0810 21:07:15.630789 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:15.630793 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:15.630803 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:07:15.630870 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:15.630872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:15.630888 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:15.631206 (+ 318us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:15.631287 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.632396 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.633770 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.634324 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.634430 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.634500 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:15.634972 (+ 472us) server_negotiation.cc:299] Negotiation successful
0810 21:07:15.635039 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":89,"threads_started":1}
I20260810 21:07:15.636011 5209 tablet_service.cc:1467] Processing CreateTablet for tablet 0c4b10763ea649898e5f948eb18e3851 (DEFAULT_TABLE table=test-table [id=1190f591a5c647cba39440a4c39e98a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:15.635999 5476 tablet_service.cc:1467] Processing CreateTablet for tablet 0c4b10763ea649898e5f948eb18e3851 (DEFAULT_TABLE table=test-table [id=1190f591a5c647cba39440a4c39e98a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:15.635298 5870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.630422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:42575 (local address 127.0.0.1:34750)
0810 21:07:15.631123 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:15.631133 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:15.631218 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:15.631436 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:15.631436 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:15.631438 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:15.631477 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.631479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.632718 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.632719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.633703 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.633706 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.634691 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.634692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.634760 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.634764 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:07:15.635168 (+ 404us) client_negotiation.cc:240] Negotiation successful
0810 21:07:15.635216 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":71,"threads_started":1}
I20260810 21:07:15.636421 5476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c4b10763ea649898e5f948eb18e3851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:15.636421 5209 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c4b10763ea649898e5f948eb18e3851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:15.637104 5725 tablet_service.cc:1467] Processing CreateTablet for tablet 0c4b10763ea649898e5f948eb18e3851 (DEFAULT_TABLE table=test-table [id=1190f591a5c647cba39440a4c39e98a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:15.637447 5725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0c4b10763ea649898e5f948eb18e3851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:15.640115 5880 tablet_bootstrap.cc:492] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Bootstrap starting.
I20260810 21:07:15.640359 5881 tablet_bootstrap.cc:492] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180: Bootstrap starting.
I20260810 21:07:15.640470 5882 tablet_bootstrap.cc:492] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e: Bootstrap starting.
I20260810 21:07:15.641132 5881 tablet_bootstrap.cc:654] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:15.641228 5882 tablet_bootstrap.cc:654] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:15.641633 5881 log.cc:824] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:15.641857 5882 log.cc:824] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:15.642459 5880 tablet_bootstrap.cc:654] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:15.642491 5881 tablet_bootstrap.cc:492] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180: No bootstrap required, opened a new log
I20260810 21:07:15.642570 5881 ts_tablet_manager.cc:1397] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:07:15.642761 5882 tablet_bootstrap.cc:492] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e: No bootstrap required, opened a new log
I20260810 21:07:15.642833 5882 ts_tablet_manager.cc:1397] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:07:15.643149 5880 log.cc:824] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:15.643905 5880 tablet_bootstrap.cc:492] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: No bootstrap required, opened a new log
I20260810 21:07:15.644011 5880 ts_tablet_manager.cc:1397] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 21:07:15.644870 5882 raft_consensus.cc:348] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } }
I20260810 21:07:15.644806 5881 raft_consensus.cc:348] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } }
I20260810 21:07:15.645022 5882 raft_consensus.cc:374] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:15.645038 5881 raft_consensus.cc:374] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:15.645066 5882 raft_consensus.cc:729] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efacecdf73c64b9da9317b726abbee2e, State: Initialized, Role: FOLLOWER
I20260810 21:07:15.645076 5881 raft_consensus.cc:729] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f8af48bf1a43a9a12865910ef55180, State: Initialized, Role: FOLLOWER
I20260810 21:07:15.645229 5882 consensus_queue.cc:260] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } }
I20260810 21:07:15.645231 5881 consensus_queue.cc:260] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } }
I20260810 21:07:15.645565 5881 ts_tablet_manager.cc:1428] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260810 21:07:15.645565 5882 ts_tablet_manager.cc:1428] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:07:15.645727 5609 heartbeater.cc:503] Master 127.15.37.62:46557 was elected leader, sending a full tablet report...
I20260810 21:07:15.646046 5849 heartbeater.cc:503] Master 127.15.37.62:46557 was elected leader, sending a full tablet report...
I20260810 21:07:15.645969 5880 raft_consensus.cc:348] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } }
I20260810 21:07:15.646147 5880 raft_consensus.cc:374] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:15.646193 5880 raft_consensus.cc:729] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0501720b15477591af1ff9b787213a, State: Initialized, Role: FOLLOWER
I20260810 21:07:15.646311 5880 consensus_queue.cc:260] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } }
I20260810 21:07:15.646618 5880 ts_tablet_manager.cc:1428] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:07:15.646679 5348 heartbeater.cc:503] Master 127.15.37.62:46557 was elected leader, sending a full tablet report...
W20260810 21:07:15.672722 5610 tablet.cc:2369] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:07:15.735085 5349 tablet.cc:2369] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:07:15.839823 5894 raft_consensus.cc:482] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:07:15.839993 5894 raft_consensus.cc:504] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } }
I20260810 21:07:15.840341 5894 leader_election.cc:288] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575), 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793)
I20260810 21:07:15.843633 5879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.840706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:43115 (local address 127.15.37.3:42575)
0810 21:07:15.840770 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:15.840773 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:15.840862 (+ 89us) server_negotiation.cc:407] Connection header received
0810 21:07:15.840934 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:15.840935 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:15.840948 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:15.841027 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:15.841210 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.841752 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.842841 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.843242 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.843342 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.843355 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:15.843519 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 21:07:15.843558 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 21:07:15.843636 5873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.840735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:50147 (local address 127.15.37.2:38793)
0810 21:07:15.840788 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:15.840790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:15.840895 (+ 105us) server_negotiation.cc:407] Connection header received
0810 21:07:15.840989 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:15.840990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:15.841002 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:15.841091 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:15.841275 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.841801 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.842847 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.843249 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.843353 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.843364 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:15.843531 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 21:07:15.843569 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 21:07:15.843658 5895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.840588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:42575 (local address 127.15.37.1:43115)
0810 21:07:15.840774 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:15.840786 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:15.840857 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:15.841032 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:15.841033 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:15.841034 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:15.841120 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.841122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.841836 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.841837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.842731 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.842734 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.843346 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.843347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.843426 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.843430 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:07:15.843498 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 21:07:15.843549 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":31,"thread_start_us":88,"threads_started":1}
I20260810 21:07:15.843668 5898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.840588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:38793 (local address 127.15.37.1:50147)
0810 21:07:15.840786 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:15.840798 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:15.840914 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:15.841099 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:15.841100 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:15.841115 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:15.841177 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.841196 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.841885 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.841886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.842735 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:15.842738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.843350 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.843352 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:15.843433 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.843442 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 21:07:15.843522 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 21:07:15.843564 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":39,"thread_start_us":85,"threads_started":1}
I20260810 21:07:15.844089 5760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c4b10763ea649898e5f948eb18e3851" candidate_uuid: "8f0501720b15477591af1ff9b787213a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efacecdf73c64b9da9317b726abbee2e" is_pre_election: true
I20260810 21:07:15.844089 5513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c4b10763ea649898e5f948eb18e3851" candidate_uuid: "8f0501720b15477591af1ff9b787213a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f8af48bf1a43a9a12865910ef55180" is_pre_election: true
I20260810 21:07:15.844264 5760 raft_consensus.cc:2454] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0501720b15477591af1ff9b787213a in term 0.
I20260810 21:07:15.844264 5513 raft_consensus.cc:2454] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f0501720b15477591af1ff9b787213a in term 0.
I20260810 21:07:15.844565 5135 leader_election.cc:302] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f8af48bf1a43a9a12865910ef55180, 8f0501720b15477591af1ff9b787213a; no voters:
I20260810 21:07:15.844714 5894 raft_consensus.cc:2781] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:07:15.844794 5894 raft_consensus.cc:482] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:07:15.844813 5894 raft_consensus.cc:3037] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 0 FOLLOWER]: Advancing to term 1
W20260810 21:07:15.845672 5850 tablet.cc:2369] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:07:15.845707 5894 raft_consensus.cc:504] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } }
I20260810 21:07:15.845929 5894 leader_election.cc:288] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 1 election: Requested vote from peers efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575), 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793)
I20260810 21:07:15.846040 5760 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c4b10763ea649898e5f948eb18e3851" candidate_uuid: "8f0501720b15477591af1ff9b787213a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efacecdf73c64b9da9317b726abbee2e"
I20260810 21:07:15.846040 5513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c4b10763ea649898e5f948eb18e3851" candidate_uuid: "8f0501720b15477591af1ff9b787213a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f8af48bf1a43a9a12865910ef55180"
I20260810 21:07:15.846138 5513 raft_consensus.cc:3037] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:15.846140 5760 raft_consensus.cc:3037] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:15.846854 5760 raft_consensus.cc:2454] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0501720b15477591af1ff9b787213a in term 1.
I20260810 21:07:15.846903 5513 raft_consensus.cc:2454] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f0501720b15477591af1ff9b787213a in term 1.
I20260810 21:07:15.847090 5130 leader_election.cc:302] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0501720b15477591af1ff9b787213a, efacecdf73c64b9da9317b726abbee2e; no voters:
I20260810 21:07:15.847210 5894 raft_consensus.cc:2781] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:07:15.847393 5894 raft_consensus.cc:686] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 1 LEADER]: Becoming Leader. State: Replica: 8f0501720b15477591af1ff9b787213a, State: Running, Role: LEADER
I20260810 21:07:15.847627 5894 consensus_queue.cc:237] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } }
I20260810 21:07:15.848647 4948 catalog_manager.cc:5495] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f0501720b15477591af1ff9b787213a (127.15.37.1). New cstate: current_term: 1 leader_uuid: "8f0501720b15477591af1ff9b787213a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } health_report { overall_health: UNKNOWN } } }
I20260810 21:07:15.864864 5872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.862311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33152 (local address 127.15.37.1:36491)
0810 21:07:15.862405 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:15.862407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:15.862416 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:07:15.862462 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:15.862464 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:15.862488 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:15.862577 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:07:15.862736 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.863229 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.864005 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:15.864226 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:15.864307 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:15.864510 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:07:15.864627 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:07:15.864730 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:15.864754 (+ 24us) server_negotiation.cc:299] Negotiation successful
0810 21:07:15.864774 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 21:07:15.867033 5760 raft_consensus.cc:1261] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e [term 1 FOLLOWER]: Refusing update from remote peer 8f0501720b15477591af1ff9b787213a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:07:15.867033 5513 raft_consensus.cc:1261] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180 [term 1 FOLLOWER]: Refusing update from remote peer 8f0501720b15477591af1ff9b787213a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:07:15.867461 5894 consensus_queue.cc:1035] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:07:15.867640 5899 consensus_queue.cc:1035] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [LEADER]: Connected to new peer: Peer: permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:07:15.871479 5904 mvcc.cc:205] Tried to move back new op lower bound from 7317078162907869184 to 7317078162832658432. Current Snapshot: MvccSnapshot[applied={T|T < 7317078162907869184}]
I20260810 21:07:15.872782 4948 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:07:15.872895 4948 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:07:15.873760 4948 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Sending DeleteTablet for 3 replicas of tablet 0c4b10763ea649898e5f948eb18e3851
I20260810 21:07:15.874109 5476 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c4b10763ea649898e5f948eb18e3851 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:15 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:46734
I20260810 21:07:15.874193 5209 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c4b10763ea649898e5f948eb18e3851 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:15 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:33142
I20260810 21:07:15.874214 5725 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c4b10763ea649898e5f948eb18e3851 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:15 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34750
I20260810 21:07:15.874367 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 5096
I20260810 21:07:15.884157 5916 tablet_replica.cc:330] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e: stopping tablet replica
I20260810 21:07:15.884352 5916 raft_consensus.cc:2229] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:07:15.884509 5916 raft_consensus.cc:2258] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:07:15.885459 5914 tablet_replica.cc:330] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180: stopping tablet replica
I20260810 21:07:15.885596 5914 raft_consensus.cc:2229] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:07:15.885686 5916 ts_tablet_manager.cc:1905] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:07:15.885728 5914 raft_consensus.cc:2258] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:07:15.886276 5914 ts_tablet_manager.cc:1905] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:07:15.887633 5916 ts_tablet_manager.cc:1918] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:07:15.887725 5916 log.cc:1196] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/0c4b10763ea649898e5f948eb18e3851
I20260810 21:07:15.888055 5916 ts_tablet_manager.cc:1939] T 0c4b10763ea649898e5f948eb18e3851 P efacecdf73c64b9da9317b726abbee2e: Deleting consensus metadata
I20260810 21:07:15.888046 5914 ts_tablet_manager.cc:1918] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:07:15.888129 5914 log.cc:1196] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/0c4b10763ea649898e5f948eb18e3851
I20260810 21:07:15.888398 5914 ts_tablet_manager.cc:1939] T 0c4b10763ea649898e5f948eb18e3851 P 63f8af48bf1a43a9a12865910ef55180: Deleting consensus metadata
I20260810 21:07:15.888671 4922 catalog_manager.cc:4841] TS efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575): tablet 0c4b10763ea649898e5f948eb18e3851 (table test-table [id=1190f591a5c647cba39440a4c39e98a3]) successfully deleted
I20260810 21:07:15.888931 4925 catalog_manager.cc:4841] TS 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793): tablet 0c4b10763ea649898e5f948eb18e3851 (table test-table [id=1190f591a5c647cba39440a4c39e98a3]) successfully deleted
W20260810 21:07:15.890997 4922 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:36491 (error 108)
I20260810 21:07:15.891381 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 5354
I20260810 21:07:15.895931 5870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:15.891544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:36491 (local address 127.0.0.1:33166)
0810 21:07:15.895814 (+ 4270us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:15.895886 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:36491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4235}
W20260810 21:07:15.896121 4922 catalog_manager.cc:4584] TS 8f0501720b15477591af1ff9b787213a (127.15.37.1:36491): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0c4b10763ea649898e5f948eb18e3851: Network error: Client connection negotiation failed: client connection to 127.15.37.1:36491: connect: Connection refused (error 111)
I20260810 21:07:15.904896 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 5614
I20260810 21:07:15.918884 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 4882
I20260810 21:07:15.936870 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:46557
--webserver_interface=127.15.37.62
--webserver_port=35045
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:46557
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:16.029364 5921 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:16.029611 5921 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:16.029639 5921 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:16.030995 5921 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:07:16.031057 5921 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:16.031072 5921 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:16.031085 5921 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:07:16.031097 5921 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:07:16.032850 5921 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:46557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:46557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=35045
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5921
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:16.033174 5921 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:16.033478 5921 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:16.045518 5930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:16.045545 5929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:16.045704 5921 server_base.cc:1034] running on GCE node
W20260810 21:07:16.045780 5933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:16.046118 5921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:16.046502 5921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:16.047725 5921 hybrid_clock.cc:648] HybridClock initialized: now 1786396036047693 us; error 58 us; skew 500 ppm
Aug 10 21:07:16 dist-test-slave-jq4t krb5kdc[4858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396036, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:16.051142 5921 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:07:16.051723 5921 webserver.cc:460] Webserver started at http://127.15.37.62:35045/ using document root <none> and password file <none>
I20260810 21:07:16.052040 5921 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:16.052139 5921 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:16.053853 5921 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:16.054890 5943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:16.055243 5921 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:16.055354 5921 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "57010f8133df48ffa7326a1bb5c8aefb"
format_stamp: "Formatted at 2026-08-10 21:07:14 on dist-test-slave-jq4t"
server_key: "93cf98ff6c4aba726322abb40c9de93f"
server_key_iv: "7c9d6c098e8973dce7d47acc35202a83"
server_key_version: "encryptionkey@0"
I20260810 21:07:16.055910 5921 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:16.069669 5921 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:16.072685 5921 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:16.072871 5921 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:16.077507 5921 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:46557
I20260810 21:07:16.077553 6041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:46557 every 8 connection(s)
I20260810 21:07:16.078215 5921 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:07:16.080122 6045 sys_catalog.cc:263] Verifying existing consensus state
I20260810 21:07:16.080909 6045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Bootstrap starting.
I20260810 21:07:16.084044 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 5921
I20260810 21:07:16.084419 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:36491
--local_ip_for_outbound_sockets=127.15.37.1
--tserver_master_addrs=127.15.37.62:46557
--webserver_port=36757
--webserver_interface=127.15.37.1
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:07:16.091423 6045 log.cc:824] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:16.093786 6045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 21:07:16.094174 6045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Bootstrap complete.
I20260810 21:07:16.096861 6045 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } }
I20260810 21:07:16.097138 6045 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57010f8133df48ffa7326a1bb5c8aefb, State: Initialized, Role: FOLLOWER
I20260810 21:07:16.097319 6045 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } }
I20260810 21:07:16.097405 6045 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:07:16.097466 6045 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:07:16.097527 6045 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 1 FOLLOWER]: Advancing to term 2
I20260810 21:07:16.098718 6045 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } }
I20260810 21:07:16.098825 6045 leader_election.cc:302] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57010f8133df48ffa7326a1bb5c8aefb; no voters:
I20260810 21:07:16.099078 6045 leader_election.cc:288] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 21:07:16.099290 6064 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 21:07:16.099421 6045 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:07:16.099469 6064 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 2 LEADER]: Becoming Leader. State: Replica: 57010f8133df48ffa7326a1bb5c8aefb, State: Running, Role: LEADER
I20260810 21:07:16.099694 6064 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } }
I20260810 21:07:16.100131 6060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "57010f8133df48ffa7326a1bb5c8aefb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } } }
I20260810 21:07:16.100239 6060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:16.100427 6065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57010f8133df48ffa7326a1bb5c8aefb. Latest consensus state: current_term: 2 leader_uuid: "57010f8133df48ffa7326a1bb5c8aefb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } } }
I20260810 21:07:16.100500 6065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:16.101007 6080 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:07:16.101891 6080 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:07:16.102051 6080 catalog_manager.cc:1259] Loaded cluster ID: 265713884a9b4f1e9707afeb1d444def
I20260810 21:07:16.102087 6080 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:07:16.102331 6080 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260810 21:07:16.105134 6080 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260810 21:07:16.107358 6080 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:07:16.107642 6080 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Loaded TSK: 0
I20260810 21:07:16.107884 6080 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 21:07:16.207140 6053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:16.207472 6053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:16.207520 6053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:16.209648 6053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:16.209738 6053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:16.209791 6053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:07:16.212363 6053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:36491
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=36757
--tserver_master_addrs=127.15.37.62:46557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:16.212745 6053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:16.213086 6053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:16.219689 6116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:16.219692 6122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:16.219691 6118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:16.220194 6053 server_base.cc:1034] running on GCE node
I20260810 21:07:16.220430 6053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:16.220796 6053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:16.222007 6053 hybrid_clock.cc:648] HybridClock initialized: now 1786396036222008 us; error 49 us; skew 500 ppm
Aug 10 21:07:16 dist-test-slave-jq4t krb5kdc[4858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396036, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:16.225499 6053 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:07:16.226143 6053 webserver.cc:460] Webserver started at http://127.15.37.1:36757/ using document root <none> and password file <none>
I20260810 21:07:16.226426 6053 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:16.226517 6053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:16.228520 6053 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:07:16.229404 6141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:16.229650 6053 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:07:16.229782 6053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "8f0501720b15477591af1ff9b787213a"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "ceb1085c416e42479f75ce960669d178"
server_key_iv: "4b0a4fd65e2289dbfb323b66e15d619b"
server_key_version: "encryptionkey@0"
I20260810 21:07:16.230201 6053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:16.252468 6053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:16.255219 6053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:16.255353 6053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:16.255716 6053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:16.256286 6155 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 21:07:16.258355 6053 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 21:07:16.258466 6053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 21:07:16.258522 6053 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 21:07:16.259467 6053 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 21:07:16.259536 6053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 21:07:16.259614 6155 tablet_bootstrap.cc:492] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Bootstrap starting.
I20260810 21:07:16.268311 6053 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:36491
I20260810 21:07:16.268849 6053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:07:16.272344 6155 log.cc:824] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:16.272754 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 6053
I20260810 21:07:16.272806 6365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:36491 every 8 connection(s)
I20260810 21:07:16.273167 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:38793
--local_ip_for_outbound_sockets=127.15.37.2
--tserver_master_addrs=127.15.37.62:46557
--webserver_port=39371
--webserver_interface=127.15.37.2
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:07:16.276050 6155 tablet_bootstrap.cc:492] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 21:07:16.276378 6155 tablet_bootstrap.cc:492] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Bootstrap complete.
I20260810 21:07:16.277827 6155 ts_tablet_manager.cc:1397] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.009s
I20260810 21:07:16.279359 6155 raft_consensus.cc:348] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } }
I20260810 21:07:16.279698 6155 raft_consensus.cc:729] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0501720b15477591af1ff9b787213a, State: Initialized, Role: FOLLOWER
I20260810 21:07:16.279865 6155 consensus_queue.cc:260] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } }
I20260810 21:07:16.280167 6155 ts_tablet_manager.cc:1428] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Time spent starting tablet: real 0.002s user 0.001s sys 0.003s
Aug 10 21:07:16 dist-test-slave-jq4t krb5kdc[4858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396036, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:16.292800 6369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.269863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:54209)
0810 21:07:16.273092 (+ 3229us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:16.273138 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:16.276285 (+ 3147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:16.278818 (+ 2533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:16.278824 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:16.279329 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:16.279878 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.279889 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.282195 (+ 2306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.282196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.283796 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.283801 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.284892 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.284893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.285056 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.285918 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:16.285941 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:16.288064 (+ 2123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:16.290651 (+ 2587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:16.290663 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:16.290665 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:16.291005 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:16.291357 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:16.291358 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:16.291358 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:16.291505 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:16.292046 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:16.292054 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:16.292224 (+ 170us) client_negotiation.cc:769] Sending connection context
0810 21:07:16.292367 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 21:07:16.292584 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3180,"thread_start_us":137,"threads_started":1}
I20260810 21:07:16.293143 6371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.269945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:54209 (local address 127.15.37.62:46557)
0810 21:07:16.273741 (+ 3796us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:16.273753 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:16.273816 (+ 63us) server_negotiation.cc:407] Connection header received
0810 21:07:16.278304 (+ 4488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:16.278316 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:16.278405 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:16.278555 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:16.280168 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.282021 (+ 1853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.283947 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.284642 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.284773 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.288224 (+ 3451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:16.288230 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:16.288230 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:16.288247 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:16.290516 (+ 2269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:16.291121 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:16.291125 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:16.291125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:16.291259 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:16.291586 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:16.291587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:16.291588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:16.291936 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:16.292021 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:16.292512 (+ 491us) server_negotiation.cc:299] Negotiation successful
0810 21:07:16.292687 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3726,"thread_start_us":87,"threads_started":1}
I20260810 21:07:16.294008 6366 heartbeater.cc:347] Connected to a master server at 127.15.37.62:46557
I20260810 21:07:16.294127 6366 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:16.294365 6366 heartbeater.cc:511] Master 127.15.37.62:46557 requested a full tablet report, sending...
I20260810 21:07:16.295292 5974 ts_manager.cc:194] Registered new tserver with Master: 8f0501720b15477591af1ff9b787213a (127.15.37.1:36491)
I20260810 21:07:16.296854 5974 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:54209
I20260810 21:07:16.297962 6366 heartbeater.cc:503] Master 127.15.37.62:46557 was elected leader, sending a full tablet report...
Aug 10 21:07:16 dist-test-slave-jq4t krb5kdc[4858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396036, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for kudu/127.15.37.1@KRBTEST.COM
I20260810 21:07:16.307704 6377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.296035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:36491 (local address 127.0.0.1:33178)
0810 21:07:16.296302 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:16.296344 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:16.296424 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:16.296695 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:16.296701 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:16.297085 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:16.297150 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.297173 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.299475 (+ 2302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.299477 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.300378 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.300384 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.301248 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.301249 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.301331 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.301977 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:16.301982 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:16.303753 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:16.306295 (+ 2542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:16.306304 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:16.306307 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:16.306555 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:16.306871 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:16.306872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:16.306872 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:16.306944 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:16.307354 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:16.307363 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:16.307420 (+ 57us) client_negotiation.cc:769] Sending connection context
0810 21:07:16.307491 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 21:07:16.307620 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":121,"threads_started":1}
I20260810 21:07:16.307789 6378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.296111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33178 (local address 127.15.37.1:36491)
0810 21:07:16.296331 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:16.296336 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:16.296439 (+ 103us) server_negotiation.cc:407] Connection header received
0810 21:07:16.296567 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:16.296570 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:16.296588 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:16.296692 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:16.297254 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.299344 (+ 2090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.300515 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.301137 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.301227 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.303888 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:16.303904 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:16.303904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:16.303914 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:16.306187 (+ 2273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:16.306661 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:16.306665 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:16.306666 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:16.306744 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:16.307038 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:16.307039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:16.307040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:16.307264 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:16.307349 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:16.307563 (+ 214us) server_negotiation.cc:299] Negotiation successful
0810 21:07:16.307683 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":84,"threads_started":1}
I20260810 21:07:16.308374 6239 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c4b10763ea649898e5f948eb18e3851 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:15 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:33178
I20260810 21:07:16.309175 6379 tablet_replica.cc:330] stopping tablet replica
I20260810 21:07:16.309325 6379 raft_consensus.cc:2229] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:07:16.309428 6379 raft_consensus.cc:2258] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:07:16.309834 6379 ts_tablet_manager.cc:1905] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:07:16.312031 6379 ts_tablet_manager.cc:1918] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:07:16.312114 6379 log.cc:1196] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal/wals/0c4b10763ea649898e5f948eb18e3851
I20260810 21:07:16.312392 6379 ts_tablet_manager.cc:1939] T 0c4b10763ea649898e5f948eb18e3851 P 8f0501720b15477591af1ff9b787213a: Deleting consensus metadata
I20260810 21:07:16.313251 5945 catalog_manager.cc:4841] TS 8f0501720b15477591af1ff9b787213a (127.15.37.1:36491): tablet 0c4b10763ea649898e5f948eb18e3851 (table test-table [id=1190f591a5c647cba39440a4c39e98a3]) successfully deleted
W20260810 21:07:16.378232 6375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:16.378556 6375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:16.378605 6375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:16.379954 6375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:16.380038 6375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:16.380084 6375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:07:16.381742 6375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:38793
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=39371
--tserver_master_addrs=127.15.37.62:46557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:16.382091 6375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:16.382380 6375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:16.388630 6387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:16.388670 6388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:16.388648 6390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:16.388881 6375 server_base.cc:1034] running on GCE node
I20260810 21:07:16.389257 6375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:16.389586 6375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:16.390797 6375 hybrid_clock.cc:648] HybridClock initialized: now 1786396036390789 us; error 56 us; skew 500 ppm
Aug 10 21:07:16 dist-test-slave-jq4t krb5kdc[4858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396036, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:16.393798 6375 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:07:16.394340 6375 webserver.cc:460] Webserver started at http://127.15.37.2:39371/ using document root <none> and password file <none>
I20260810 21:07:16.394550 6375 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:16.394604 6375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:16.396046 6375 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:16.396719 6404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:16.396931 6375 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:16.397032 6375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "63f8af48bf1a43a9a12865910ef55180"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "07a1c03a4b4cf2b0811609411c2b5822"
server_key_iv: "d64dc158185f043e7e37ed1cf9bbff73"
server_key_version: "encryptionkey@0"
I20260810 21:07:16.397394 6375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:16.409363 6375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:16.411772 6375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:16.411914 6375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:16.412145 6375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:16.412618 6375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:16.412662 6375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:16.412688 6375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:16.412736 6375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:16.420241 6375 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:38793
I20260810 21:07:16.420279 6619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:38793 every 8 connection(s)
I20260810 21:07:16.420847 6375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:07:16.421340 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 6375
I20260810 21:07:16.421820 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:42575
--local_ip_for_outbound_sockets=127.15.37.3
--tserver_master_addrs=127.15.37.62:46557
--webserver_port=45217
--webserver_interface=127.15.37.3
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 21:07:16 dist-test-slave-jq4t krb5kdc[4858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396036, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:16.434082 6371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.422141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:45873 (local address 127.15.37.62:46557)
0810 21:07:16.422206 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:16.422208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:16.422450 (+ 242us) server_negotiation.cc:407] Connection header received
0810 21:07:16.423404 (+ 954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:16.423405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:16.423425 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:16.423485 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:16.425033 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.425790 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.427491 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.427723 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.427790 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.430786 (+ 2996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:16.430788 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:16.430789 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:16.430797 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:16.432389 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:16.432920 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:16.432921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:16.432922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:16.432987 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:16.433302 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:16.433303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:16.433303 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:16.433435 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:16.433530 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:16.433868 (+ 338us) server_negotiation.cc:299] Negotiation successful
0810 21:07:16.433980 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 21:07:16.434290 6622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.422117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:45873)
0810 21:07:16.422301 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:16.422349 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:16.423241 (+ 892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:16.423566 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:16.423575 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:16.424447 (+ 872us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:16.424815 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.424823 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.425924 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.425925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.427357 (+ 1432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.427362 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.427848 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.427850 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.428032 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.428812 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:16.428825 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:16.430639 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:16.432524 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:16.432537 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:16.432539 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:16.432807 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:16.433089 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:16.433090 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:16.433091 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:16.433216 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:16.433512 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:16.433520 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:16.433689 (+ 169us) client_negotiation.cc:769] Sending connection context
0810 21:07:16.433805 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 21:07:16.434005 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":104,"threads_started":1}
I20260810 21:07:16.434880 6620 heartbeater.cc:347] Connected to a master server at 127.15.37.62:46557
I20260810 21:07:16.434988 6620 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:16.435220 6620 heartbeater.cc:511] Master 127.15.37.62:46557 requested a full tablet report, sending...
I20260810 21:07:16.435696 5974 ts_manager.cc:194] Registered new tserver with Master: 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793)
I20260810 21:07:16.436286 5974 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:45873
W20260810 21:07:16.514407 6623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:16.514639 6623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:16.514667 6623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:16.516050 6623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:16.516099 6623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:16.516127 6623 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:07:16.517906 6623 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:42575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=45217
--tserver_master_addrs=127.15.37.62:46557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:16.518141 6623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:16.518340 6623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:16.525400 6640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:16.525396 6633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:16.525396 6638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:16.525779 6623 server_base.cc:1034] running on GCE node
I20260810 21:07:16.526127 6623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:16.526467 6623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:16.527657 6623 hybrid_clock.cc:648] HybridClock initialized: now 1786396036527645 us; error 32 us; skew 500 ppm
Aug 10 21:07:16 dist-test-slave-jq4t krb5kdc[4858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396036, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:16.530558 6623 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:07:16.531077 6623 webserver.cc:460] Webserver started at http://127.15.37.3:45217/ using document root <none> and password file <none>
I20260810 21:07:16.531356 6623 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:16.531466 6623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:16.533013 6623 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:07:16.533740 6654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:16.534008 6623 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:16.534147 6623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "efacecdf73c64b9da9317b726abbee2e"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "86434c52b6c0448accdd8f4669eec549"
server_key_iv: "6dfb4f9f551dc0f87c4637d93925d7b9"
server_key_version: "encryptionkey@0"
I20260810 21:07:16.534545 6623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:16.555269 6623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:16.557767 6623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:16.557899 6623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:16.558223 6623 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:16.558600 6623 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:16.558638 6623 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:16.558662 6623 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:16.558676 6623 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:16.565333 6623 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:42575
I20260810 21:07:16.565450 6852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:42575 every 8 connection(s)
I20260810 21:07:16.565794 6623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:07:16.570804 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 6623
Aug 10 21:07:16 dist-test-slave-jq4t krb5kdc[4858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396036, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:16.576790 6371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.566682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:40881 (local address 127.15.37.62:46557)
0810 21:07:16.566734 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:16.566736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:16.566993 (+ 257us) server_negotiation.cc:407] Connection header received
0810 21:07:16.567552 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:16.567553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:16.567564 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:16.567618 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:16.568723 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.569249 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.570345 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.570614 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.570698 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.573467 (+ 2769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:16.573468 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:16.573469 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:16.573477 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:16.575149 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:16.575644 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:16.575645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:16.575646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:16.575713 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:16.576008 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:16.576009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:16.576009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:16.576136 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:16.576218 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:16.576595 (+ 377us) server_negotiation.cc:299] Negotiation successful
0810 21:07:16.576687 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 21:07:16.577031 6856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.566662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:40881)
0810 21:07:16.566837 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:16.566905 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:16.567449 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:16.567674 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:16.567677 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:16.568311 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:16.568624 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.568630 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.569355 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.569356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.570249 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.570252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.570723 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.570724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.570872 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.571635 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:16.571647 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:16.573329 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:16.575256 (+ 1927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:16.575269 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:16.575272 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:16.575552 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:16.575796 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:16.575797 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:16.575798 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:16.575932 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:16.576221 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:16.576230 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:16.576403 (+ 173us) client_negotiation.cc:769] Sending connection context
0810 21:07:16.576555 (+ 152us) client_negotiation.cc:240] Negotiation successful
0810 21:07:16.576755 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
I20260810 21:07:16.577574 6853 heartbeater.cc:347] Connected to a master server at 127.15.37.62:46557
I20260810 21:07:16.577687 6853 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:16.577947 6853 heartbeater.cc:511] Master 127.15.37.62:46557 requested a full tablet report, sending...
I20260810 21:07:16.578434 5974 ts_manager.cc:194] Registered new tserver with Master: efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575)
I20260810 21:07:16.578713 6862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.571363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34250 (local address 127.15.37.62:46557)
0810 21:07:16.571515 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:16.571517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:16.571622 (+ 105us) server_negotiation.cc:407] Connection header received
0810 21:07:16.571652 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:16.571653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:16.571666 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:16.571758 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:16.572402 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.573018 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.573810 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.574102 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.574185 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.575672 (+ 1487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:16.575674 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:16.575674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:16.575682 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:16.577407 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:16.577844 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:16.577846 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:16.577846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:16.577914 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:16.578143 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:16.578144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:16.578145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:16.578265 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:16.578463 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:16.578504 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 21:07:16.578601 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":75,"threads_started":1}
I20260810 21:07:16.578971 5974 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:40881
I20260810 21:07:16.579602 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:07:16.582556 6862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.580020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34262 (local address 127.15.37.62:46557)
0810 21:07:16.580062 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:16.580064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:16.580246 (+ 182us) server_negotiation.cc:407] Connection header received
0810 21:07:16.580287 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:16.580288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:16.580324 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:16.580398 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:07:16.580570 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.581087 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.581883 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.582084 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.582143 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.582282 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:07:16.582385 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:07:16.582444 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:16.582477 (+ 33us) server_negotiation.cc:299] Negotiation successful
0810 21:07:16.582497 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 21:07:16.582913 5974 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:34262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:07:16.584673 5974 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:07:16.587177 6239 tablet_service.cc:1467] Processing CreateTablet for tablet 11f82abc61b5473cade177d47ef90590 (DEFAULT_TABLE table=test-table [id=de1de05357ae45ac9810b798a0b0435c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:16.587410 6239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11f82abc61b5473cade177d47ef90590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:16.589334 6155 tablet_bootstrap.cc:492] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a: Bootstrap starting.
I20260810 21:07:16.589723 6155 tablet_bootstrap.cc:654] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:16.590358 6155 tablet_bootstrap.cc:492] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a: No bootstrap required, opened a new log
I20260810 21:07:16.590411 6155 ts_tablet_manager.cc:1397] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260810 21:07:16.590797 6155 raft_consensus.cc:348] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:16.590888 6864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.586717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:42575 (local address 127.0.0.1:34754)
0810 21:07:16.587223 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:16.587233 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:16.587292 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:16.587498 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:16.587499 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:16.587501 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:16.587559 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.587560 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.588678 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.588679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.589607 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.589611 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.590608 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.590609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.590670 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.590698 (+ 28us) client_negotiation.cc:769] Sending connection context
0810 21:07:16.590729 (+ 31us) client_negotiation.cc:240] Negotiation successful
0810 21:07:16.590769 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":25,"thread_start_us":108,"threads_started":1}
I20260810 21:07:16.590925 6155 raft_consensus.cc:374] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:16.590986 6155 raft_consensus.cc:729] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0501720b15477591af1ff9b787213a, State: Initialized, Role: FOLLOWER
I20260810 21:07:16.591043 6155 consensus_queue.cc:260] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:16.591131 6155 ts_tablet_manager.cc:1428] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260810 21:07:16.591303 6869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.587002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34754 (local address 127.15.37.3:42575)
0810 21:07:16.587210 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:16.587216 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:16.587280 (+ 64us) server_negotiation.cc:407] Connection header received
0810 21:07:16.587388 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:16.587390 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:16.587408 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:16.587478 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:16.587616 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.588560 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.589715 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.590518 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.591061 (+ 543us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.591143 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:16.591171 (+ 28us) server_negotiation.cc:299] Negotiation successful
0810 21:07:16.591218 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":126,"threads_started":1}
I20260810 21:07:16.592041 6740 tablet_service.cc:1467] Processing CreateTablet for tablet 11f82abc61b5473cade177d47ef90590 (DEFAULT_TABLE table=test-table [id=de1de05357ae45ac9810b798a0b0435c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:16.592449 6740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11f82abc61b5473cade177d47ef90590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:16.592790 6377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.586716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:38793 (local address 127.0.0.1:46746)
0810 21:07:16.586761 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:16.586776 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:16.586832 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:16.588824 (+ 1992us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:16.588826 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:16.588828 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:16.588881 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.588882 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.590461 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.590462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.591553 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.591556 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.592450 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.592451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.592590 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.592596 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 21:07:16.592669 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 21:07:16.592721 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22,"mutex_wait_us":3}
I20260810 21:07:16.592798 6866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.586838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46746 (local address 127.15.37.2:38793)
0810 21:07:16.588629 (+ 1791us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:16.588634 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:16.588648 (+ 14us) server_negotiation.cc:407] Connection header received
0810 21:07:16.588693 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:16.588695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:16.588711 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:16.588954 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:16.589033 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.590269 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.591662 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.592345 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.592421 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.592462 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:16.592688 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 21:07:16.592726 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1745,"thread_start_us":120,"threads_started":1}
I20260810 21:07:16.593552 6494 tablet_service.cc:1467] Processing CreateTablet for tablet 11f82abc61b5473cade177d47ef90590 (DEFAULT_TABLE table=test-table [id=de1de05357ae45ac9810b798a0b0435c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:16.593968 6494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11f82abc61b5473cade177d47ef90590. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:16.595819 6871 tablet_bootstrap.cc:492] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e: Bootstrap starting.
I20260810 21:07:16.596468 6871 tablet_bootstrap.cc:654] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:16.597147 6873 tablet_bootstrap.cc:492] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180: Bootstrap starting.
I20260810 21:07:16.597328 6871 log.cc:824] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:16.597827 6873 tablet_bootstrap.cc:654] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:16.598263 6871 tablet_bootstrap.cc:492] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e: No bootstrap required, opened a new log
I20260810 21:07:16.598367 6871 ts_tablet_manager.cc:1397] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:07:16.598481 6873 log.cc:824] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:16.599267 6873 tablet_bootstrap.cc:492] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180: No bootstrap required, opened a new log
I20260810 21:07:16.599349 6873 ts_tablet_manager.cc:1397] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:07:16.600703 6871 raft_consensus.cc:348] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:16.600957 6871 raft_consensus.cc:374] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:16.601001 6871 raft_consensus.cc:729] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efacecdf73c64b9da9317b726abbee2e, State: Initialized, Role: FOLLOWER
I20260810 21:07:16.601138 6871 consensus_queue.cc:260] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:16.601486 6871 ts_tablet_manager.cc:1428] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:07:16.601536 6853 heartbeater.cc:503] Master 127.15.37.62:46557 was elected leader, sending a full tablet report...
I20260810 21:07:16.602000 6873 raft_consensus.cc:348] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:16.602178 6873 raft_consensus.cc:374] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:16.602223 6873 raft_consensus.cc:729] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f8af48bf1a43a9a12865910ef55180, State: Initialized, Role: FOLLOWER
I20260810 21:07:16.602342 6873 consensus_queue.cc:260] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:16.602698 6873 ts_tablet_manager.cc:1428] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:07:16.602716 6620 heartbeater.cc:503] Master 127.15.37.62:46557 was elected leader, sending a full tablet report...
W20260810 21:07:16.674845 6621 tablet.cc:2369] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:07:16.773473 6368 tablet.cc:2369] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:07:16.816563 6854 tablet.cc:2369] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:07:16.858959 6876 raft_consensus.cc:482] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:07:16.859129 6876 raft_consensus.cc:504] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:16.859611 6876 leader_election.cc:288] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793), 8f0501720b15477591af1ff9b787213a (127.15.37.1:36491)
I20260810 21:07:16.862972 6866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.860052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:58027 (local address 127.15.37.2:38793)
0810 21:07:16.860108 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:16.860110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:16.860261 (+ 151us) server_negotiation.cc:407] Connection header received
0810 21:07:16.860338 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:16.860339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:16.860353 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:16.860451 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:16.860664 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.861141 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.862161 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.862566 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.862668 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.862681 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:16.862848 (+ 167us) server_negotiation.cc:299] Negotiation successful
0810 21:07:16.862891 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 21:07:16.862977 6879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.859982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:53577 (local address 127.15.37.1:36491)
0810 21:07:16.860174 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:16.860176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:16.860183 (+ 7us) server_negotiation.cc:407] Connection header received
0810 21:07:16.860212 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:16.860213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:16.860237 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:16.860344 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:16.860582 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.861112 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.862156 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.862589 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.862691 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.862780 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:16.862844 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 21:07:16.862887 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":78,"threads_started":1}
I20260810 21:07:16.863004 6856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.859906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:36491 (local address 127.15.37.3:53577)
0810 21:07:16.859982 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:16.859996 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:16.860056 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:16.860352 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:16.860353 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:16.860356 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:16.860440 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.860442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.861218 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.861219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.862041 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.862044 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.862691 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.862692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.862775 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.862778 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:07:16.862833 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 21:07:16.862887 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":1}
I20260810 21:07:16.863013 6880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.859906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:38793 (local address 127.15.37.3:58027)
0810 21:07:16.860163 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:16.860173 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:16.860278 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:16.860459 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:16.860460 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:16.860462 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:16.860567 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.860569 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.861238 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.861239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.862050 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:16.862053 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.862672 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.862674 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:16.862750 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.862756 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 21:07:16.862842 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 21:07:16.862886 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":71,"thread_start_us":100,"threads_started":1}
I20260810 21:07:16.863368 6280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f82abc61b5473cade177d47ef90590" candidate_uuid: "efacecdf73c64b9da9317b726abbee2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0501720b15477591af1ff9b787213a" is_pre_election: true
I20260810 21:07:16.863555 6280 raft_consensus.cc:2454] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efacecdf73c64b9da9317b726abbee2e in term 0.
I20260810 21:07:16.863782 6526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f82abc61b5473cade177d47ef90590" candidate_uuid: "efacecdf73c64b9da9317b726abbee2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f8af48bf1a43a9a12865910ef55180" is_pre_election: true
I20260810 21:07:16.863823 6657 leader_election.cc:302] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0501720b15477591af1ff9b787213a, efacecdf73c64b9da9317b726abbee2e; no voters:
I20260810 21:07:16.863929 6526 raft_consensus.cc:2454] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efacecdf73c64b9da9317b726abbee2e in term 0.
I20260810 21:07:16.863972 6876 raft_consensus.cc:2781] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:07:16.864037 6876 raft_consensus.cc:482] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:07:16.864068 6876 raft_consensus.cc:3037] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:16.864928 6876 raft_consensus.cc:504] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:16.865116 6876 leader_election.cc:288] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [CANDIDATE]: Term 1 election: Requested vote from peers 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793), 8f0501720b15477591af1ff9b787213a (127.15.37.1:36491)
I20260810 21:07:16.865294 6280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f82abc61b5473cade177d47ef90590" candidate_uuid: "efacecdf73c64b9da9317b726abbee2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f0501720b15477591af1ff9b787213a"
I20260810 21:07:16.865310 6526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f82abc61b5473cade177d47ef90590" candidate_uuid: "efacecdf73c64b9da9317b726abbee2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f8af48bf1a43a9a12865910ef55180"
I20260810 21:07:16.865389 6526 raft_consensus.cc:3037] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:16.865389 6280 raft_consensus.cc:3037] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:16.866124 6280 raft_consensus.cc:2454] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efacecdf73c64b9da9317b726abbee2e in term 1.
I20260810 21:07:16.866150 6526 raft_consensus.cc:2454] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efacecdf73c64b9da9317b726abbee2e in term 1.
I20260810 21:07:16.866303 6657 leader_election.cc:302] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f0501720b15477591af1ff9b787213a, efacecdf73c64b9da9317b726abbee2e; no voters:
I20260810 21:07:16.866395 6876 raft_consensus.cc:2781] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:07:16.866568 6876 raft_consensus.cc:686] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [term 1 LEADER]: Becoming Leader. State: Replica: efacecdf73c64b9da9317b726abbee2e, State: Running, Role: LEADER
I20260810 21:07:16.866686 6876 consensus_queue.cc:237] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:16.867630 5974 catalog_manager.cc:5495] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e reported cstate change: term changed from 0 to 1, leader changed from <none> to efacecdf73c64b9da9317b726abbee2e (127.15.37.3). New cstate: current_term: 1 leader_uuid: "efacecdf73c64b9da9317b726abbee2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } health_report { overall_health: UNKNOWN } } }
I20260810 21:07:16.878091 6869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.875410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34756 (local address 127.15.37.3:42575)
0810 21:07:16.875497 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:16.875499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:16.875507 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:07:16.875560 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:16.875561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:16.875585 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:16.875665 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:07:16.875835 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.876336 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.877192 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:16.877414 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:16.877504 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:16.877688 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:07:16.877817 (+ 129us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:07:16.877918 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:16.877939 (+ 21us) server_negotiation.cc:299] Negotiation successful
0810 21:07:16.877965 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 21:07:16.880383 6280 raft_consensus.cc:1261] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Refusing update from remote peer efacecdf73c64b9da9317b726abbee2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:07:16.880383 6526 raft_consensus.cc:1261] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180 [term 1 FOLLOWER]: Refusing update from remote peer efacecdf73c64b9da9317b726abbee2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:07:16.880859 6881 consensus_queue.cc:1035] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:07:16.881021 6876 consensus_queue.cc:1035] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:07:16.883529 6888 mvcc.cc:205] Tried to move back new op lower bound from 7317078167058268160 to 7317078167006547968. Current Snapshot: MvccSnapshot[applied={T|T < 7317078167058268160}]
I20260810 21:07:16.883680 6889 mvcc.cc:205] Tried to move back new op lower bound from 7317078167058268160 to 7317078167006547968. Current Snapshot: MvccSnapshot[applied={T|T < 7317078167058268160}]
I20260810 21:07:16.884058 6890 mvcc.cc:205] Tried to move back new op lower bound from 7317078167058268160 to 7317078167006547968. Current Snapshot: MvccSnapshot[applied={T|T < 7317078167058268160}]
I20260810 21:07:16.886732 5971 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:34262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:07:16.886829 5971 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:34262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:07:16.887677 5971 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Sending DeleteTablet for 3 replicas of tablet 11f82abc61b5473cade177d47ef90590
I20260810 21:07:16.888029 6239 tablet_service.cc:1514] Processing DeleteTablet for tablet 11f82abc61b5473cade177d47ef90590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:16 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:33178
I20260810 21:07:16.888049 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 6053
I20260810 21:07:16.888051 6740 tablet_service.cc:1514] Processing DeleteTablet for tablet 11f82abc61b5473cade177d47ef90590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:16 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34754
I20260810 21:07:16.888099 6494 tablet_service.cc:1514] Processing DeleteTablet for tablet 11f82abc61b5473cade177d47ef90590 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:16 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:46746
I20260810 21:07:16.893309 6902 tablet_replica.cc:330] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e: stopping tablet replica
I20260810 21:07:16.893502 6902 raft_consensus.cc:2229] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:07:16.893728 6902 raft_consensus.cc:2258] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:07:16.897207 6902 ts_tablet_manager.cc:1905] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:07:16.899261 6902 ts_tablet_manager.cc:1918] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:07:16.899484 6902 log.cc:1196] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/11f82abc61b5473cade177d47ef90590
I20260810 21:07:16.899510 6904 tablet_replica.cc:330] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180: stopping tablet replica
I20260810 21:07:16.899662 6904 raft_consensus.cc:2229] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:07:16.899859 6904 raft_consensus.cc:2258] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:07:16.900102 6902 ts_tablet_manager.cc:1939] T 11f82abc61b5473cade177d47ef90590 P efacecdf73c64b9da9317b726abbee2e: Deleting consensus metadata
I20260810 21:07:16.900671 5945 catalog_manager.cc:4841] TS efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575): tablet 11f82abc61b5473cade177d47ef90590 (table test-table [id=de1de05357ae45ac9810b798a0b0435c]) successfully deleted
I20260810 21:07:16.900871 6904 ts_tablet_manager.cc:1905] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:07:16.902704 6904 ts_tablet_manager.cc:1918] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:07:16.902803 6904 log.cc:1196] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/11f82abc61b5473cade177d47ef90590
I20260810 21:07:16.903111 6904 ts_tablet_manager.cc:1939] T 11f82abc61b5473cade177d47ef90590 P 63f8af48bf1a43a9a12865910ef55180: Deleting consensus metadata
I20260810 21:07:16.903679 5947 catalog_manager.cc:4841] TS 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793): tablet 11f82abc61b5473cade177d47ef90590 (table test-table [id=de1de05357ae45ac9810b798a0b0435c]) successfully deleted
W20260810 21:07:16.909328 5945 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:36491 (error 108)
I20260810 21:07:16.909684 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 6375
I20260810 21:07:16.910130 6377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:16.909993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:36491 (local address 127.0.0.1:33194)
0810 21:07:16.910049 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:16.910084 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:36491: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 21:07:16.910260 5945 catalog_manager.cc:4584] TS 8f0501720b15477591af1ff9b787213a (127.15.37.1:36491): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 11f82abc61b5473cade177d47ef90590: Network error: Client connection negotiation failed: client connection to 127.15.37.1:36491: connect: Connection refused (error 111)
I20260810 21:07:16.932078 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 6623
I20260810 21:07:16.952701 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 5921
I20260810 21:07:16.972137 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:46557
--webserver_interface=127.15.37.62
--webserver_port=35045
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:46557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:17.061779 6913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:17.062041 6913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:17.062067 6913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:17.063719 6913 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:07:17.063812 6913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:17.063828 6913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:17.063843 6913 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:07:17.063858 6913 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:07:17.065790 6913 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:46557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:46557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=35045
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:17.066128 6913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:17.066468 6913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:17.072382 6923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:17.072371 6925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:17.072405 6913 server_base.cc:1034] running on GCE node
W20260810 21:07:17.072371 6920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:17.073189 6913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:17.073551 6913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:17.074741 6913 hybrid_clock.cc:648] HybridClock initialized: now 1786396037074732 us; error 60 us; skew 500 ppm
Aug 10 21:07:17 dist-test-slave-jq4t krb5kdc[4858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396037, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:17.077756 6913 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:07:17.078439 6913 webserver.cc:460] Webserver started at http://127.15.37.62:35045/ using document root <none> and password file <none>
I20260810 21:07:17.078709 6913 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:17.078805 6913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:17.080672 6913 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:07:17.081576 6944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:17.081779 6913 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:17.081930 6913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "57010f8133df48ffa7326a1bb5c8aefb"
format_stamp: "Formatted at 2026-08-10 21:07:14 on dist-test-slave-jq4t"
server_key: "93cf98ff6c4aba726322abb40c9de93f"
server_key_iv: "7c9d6c098e8973dce7d47acc35202a83"
server_key_version: "encryptionkey@0"
I20260810 21:07:17.082355 6913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:17.101099 6913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:17.103847 6913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:17.104058 6913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:17.109225 6913 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:46557
I20260810 21:07:17.109261 7036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:46557 every 8 connection(s)
I20260810 21:07:17.109704 6913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:07:17.111513 7039 sys_catalog.cc:263] Verifying existing consensus state
I20260810 21:07:17.112311 7039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Bootstrap starting.
I20260810 21:07:17.119258 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 6913
I20260810 21:07:17.119624 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:36491
--local_ip_for_outbound_sockets=127.15.37.1
--tserver_master_addrs=127.15.37.62:46557
--webserver_port=36757
--webserver_interface=127.15.37.1
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:07:17.123082 7039 log.cc:824] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:17.125911 7039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 21:07:17.126307 7039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb: Bootstrap complete.
I20260810 21:07:17.128974 7039 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } }
I20260810 21:07:17.129281 7039 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57010f8133df48ffa7326a1bb5c8aefb, State: Initialized, Role: FOLLOWER
I20260810 21:07:17.129513 7039 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } }
I20260810 21:07:17.129631 7039 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:07:17.129691 7039 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:07:17.129743 7039 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 2 FOLLOWER]: Advancing to term 3
I20260810 21:07:17.130927 7039 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } }
I20260810 21:07:17.131088 7039 leader_election.cc:302] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57010f8133df48ffa7326a1bb5c8aefb; no voters:
I20260810 21:07:17.131338 7039 leader_election.cc:288] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 21:07:17.131400 7049 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 3 FOLLOWER]: Leader election won for term 3
I20260810 21:07:17.131534 7049 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [term 3 LEADER]: Becoming Leader. State: Replica: 57010f8133df48ffa7326a1bb5c8aefb, State: Running, Role: LEADER
I20260810 21:07:17.131645 7049 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } }
I20260810 21:07:17.131697 7039 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:07:17.131958 7049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57010f8133df48ffa7326a1bb5c8aefb. Latest consensus state: current_term: 3 leader_uuid: "57010f8133df48ffa7326a1bb5c8aefb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } } }
I20260810 21:07:17.132045 7049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:17.131963 7050 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "57010f8133df48ffa7326a1bb5c8aefb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57010f8133df48ffa7326a1bb5c8aefb" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46557 } } }
I20260810 21:07:17.132099 7050 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57010f8133df48ffa7326a1bb5c8aefb [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:17.132736 7053 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:07:17.133667 7053 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:07:17.133801 7053 catalog_manager.cc:1259] Loaded cluster ID: 265713884a9b4f1e9707afeb1d444def
I20260810 21:07:17.133847 7053 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260810 21:07:17.134397 7053 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f833a9419ad google::LogMessage::Fail() at ??:0
@ 0x7f833a94488a google::LogMessage::SendToLog() at ??:0
@ 0x7f833a9414de google::LogMessage::Flush() at ??:0
@ 0x7f833a942a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f83428620f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f834286b8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f833c80f0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f833c804954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f833d6686db start_thread at ??:0
@ 0x7f833943f61f clone at ??:0
W20260810 21:07:17.221962 7042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:17.222239 7042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:17.222286 7042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:17.223528 7042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:17.223609 7042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:17.223659 7042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:07:17.225355 7042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:36491
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=36757
--tserver_master_addrs=127.15.37.62:46557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:17.225673 7042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:17.225957 7042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:17.231657 7098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:17.231650 7104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:17.231832 7042 server_base.cc:1034] running on GCE node
W20260810 21:07:17.231704 7099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:17.232236 7042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:17.232621 7042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:17.233829 7042 hybrid_clock.cc:648] HybridClock initialized: now 1786396037233802 us; error 46 us; skew 500 ppm
Aug 10 21:07:17 dist-test-slave-jq4t krb5kdc[4858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396037, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:17.236989 7042 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:07:17.237491 7042 webserver.cc:460] Webserver started at http://127.15.37.1:36757/ using document root <none> and password file <none>
I20260810 21:07:17.237766 7042 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:17.237847 7042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:17.239478 7042 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:17.240386 7116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:17.240661 7042 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:17.240782 7042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "8f0501720b15477591af1ff9b787213a"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "ceb1085c416e42479f75ce960669d178"
server_key_iv: "4b0a4fd65e2289dbfb323b66e15d619b"
server_key_version: "encryptionkey@0"
I20260810 21:07:17.241199 7042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:17.258533 7042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:17.261188 7042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:17.261384 7042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:17.261662 7042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:17.262228 7126 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 21:07:17.264757 7042 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 21:07:17.264834 7042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20260810 21:07:17.264881 7042 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 21:07:17.265559 7042 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 21:07:17.265623 7042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 21:07:17.265750 7126 tablet_bootstrap.cc:492] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a: Bootstrap starting.
I20260810 21:07:17.273742 7042 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:36491
I20260810 21:07:17.273928 7313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:36491 every 8 connection(s)
I20260810 21:07:17.274241 7042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:07:17.277539 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 7042
I20260810 21:07:17.277882 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:38793
--local_ip_for_outbound_sockets=127.15.37.2
--tserver_master_addrs=127.15.37.62:46557
--webserver_port=39371
--webserver_interface=127.15.37.2
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:07:17.280280 7126 log.cc:824] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:17.282754 7126 tablet_bootstrap.cc:492] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 21:07:17.283126 7126 tablet_bootstrap.cc:492] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a: Bootstrap complete.
I20260810 21:07:17.284205 7126 ts_tablet_manager.cc:1397] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.007s
I20260810 21:07:17.285393 7126 raft_consensus.cc:348] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:17.285665 7126 raft_consensus.cc:729] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f0501720b15477591af1ff9b787213a, State: Initialized, Role: FOLLOWER
I20260810 21:07:17.285828 7126 consensus_queue.cc:260] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:17.286180 7126 ts_tablet_manager.cc:1428] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a: Time spent starting tablet: real 0.002s user 0.005s sys 0.001s
W20260810 21:07:17.404757 7319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:17.405030 7319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:17.405061 7319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:17.406605 7319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:17.406677 7319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:17.406710 7319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:07:17.408742 7319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:38793
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=39371
--tserver_master_addrs=127.15.37.62:46557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:17.409162 7319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:17.409463 7319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:17.420455 7331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:17.420526 7333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:17.420468 7330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:17.420831 7319 server_base.cc:1034] running on GCE node
I20260810 21:07:17.421079 7319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:17.421412 7319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
W20260810 21:07:17.422096 7318 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:07:17.275086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:57863)
0810 21:07:17.275297 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:17.275337 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:17.275848 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:17.421860 (+146012us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":114,"threads_started":1}
W20260810 21:07:17.422458 7314 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:46557 (0 consecutive failures): Network error: Failed to ping master at 127.15.37.62:46557: Client connection negotiation failed: client connection to 127.15.37.62:46557: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 21:07:17.422762 7319 hybrid_clock.cc:648] HybridClock initialized: now 1786396037422739 us; error 43 us; skew 500 ppm
I20260810 21:07:17.422837 7318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:17.422700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:38503)
0810 21:07:17.422766 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:17.422812 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 21:07:17.423316 7318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:17.423187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:46419)
0810 21:07:17.423248 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:17.423281 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 21:07:17.423470 7314 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 21:07:17 dist-test-slave-jq4t krb5kdc[4858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396037, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:17.425850 7319 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:07:17.426365 7319 webserver.cc:460] Webserver started at http://127.15.37.2:39371/ using document root <none> and password file <none>
I20260810 21:07:17.426631 7319 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:17.426681 7319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:17.428191 7319 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:07:17.428929 7343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:17.429126 7319 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 21:07:17.429220 7319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "63f8af48bf1a43a9a12865910ef55180"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "07a1c03a4b4cf2b0811609411c2b5822"
server_key_iv: "d64dc158185f043e7e37ed1cf9bbff73"
server_key_version: "encryptionkey@0"
I20260810 21:07:17.429592 7319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:17.448837 7319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:17.451040 7319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:17.451172 7319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:17.451386 7319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:17.451756 7319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:17.451792 7319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:17.451817 7319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:17.451875 7319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:17.460106 7319 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:38793
I20260810 21:07:17.460196 7540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:38793 every 8 connection(s)
I20260810 21:07:17.460683 7319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:07:17.462478 7544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:17.461572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:40471)
0810 21:07:17.461817 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:17.461929 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":109,"threads_started":1}
W20260810 21:07:17.464649 7541 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:46557 (0 consecutive failures): Network error: Failed to ping master at 127.15.37.62:46557: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
I20260810 21:07:17.466406 7544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:17.464871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:34113)
0810 21:07:17.466320 (+ 1449us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:17.466364 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1421}
I20260810 21:07:17.466807 7544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:17.466711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:60195)
0810 21:07:17.466753 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:17.466777 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 21:07:17.466827 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 7319
W20260810 21:07:17.466921 7541 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 21:07:17.467208 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:42575
--local_ip_for_outbound_sockets=127.15.37.3
--tserver_master_addrs=127.15.37.62:46557
--webserver_port=45217
--webserver_interface=127.15.37.3
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:35895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:17.561895 7545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:17.562196 7545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:17.562242 7545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:17.563496 7545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:17.563591 7545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:17.563639 7545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:07:17.565395 7545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:35895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:42575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=45217
--tserver_master_addrs=127.15.37.62:46557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:17.565706 7545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:17.565979 7545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:17.571928 7551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:17.571978 7559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:17.571962 7552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:17.572268 7545 server_base.cc:1034] running on GCE node
I20260810 21:07:17.572455 7545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:17.572770 7545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:17.573975 7545 hybrid_clock.cc:648] HybridClock initialized: now 1786396037573961 us; error 32 us; skew 500 ppm
Aug 10 21:07:17 dist-test-slave-jq4t krb5kdc[4858](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396037, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:17.576836 7545 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:07:17.577421 7545 webserver.cc:460] Webserver started at http://127.15.37.3:45217/ using document root <none> and password file <none>
I20260810 21:07:17.577704 7545 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:17.577785 7545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:17.579324 7545 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:17.580142 7570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:17.580431 7545 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:17.580574 7545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "efacecdf73c64b9da9317b726abbee2e"
format_stamp: "Formatted at 2026-08-10 21:07:15 on dist-test-slave-jq4t"
server_key: "86434c52b6c0448accdd8f4669eec549"
server_key_iv: "6dfb4f9f551dc0f87c4637d93925d7b9"
server_key_version: "encryptionkey@0"
I20260810 21:07:17.581015 7545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:17.597617 7545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:17.599793 7545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:17.600035 7545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:17.600329 7545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:17.600752 7545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:17.600818 7545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:17.600857 7545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:17.600909 7545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:17.607678 7545 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:42575
I20260810 21:07:17.607735 7767 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:42575 every 8 connection(s)
I20260810 21:07:17.608136 7545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:07:17.609424 7775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:17.608916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:42619)
0810 21:07:17.609127 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:17.609224 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":84,"threads_started":1}
W20260810 21:07:17.609949 7770 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:46557 (0 consecutive failures): Network error: Failed to ping master at 127.15.37.62:46557: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
I20260810 21:07:17.610294 7775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:17.610183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:50869)
0810 21:07:17.610238 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:17.610267 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 21:07:17.610608 7775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:17.610501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:51603)
0810 21:07:17.610564 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:17.610587 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 21:07:17.610723 7770 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 21:07:17.614176 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 7545
I20260810 21:07:18.424337 7779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:18.424016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:34439)
0810 21:07:18.424211 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:18.424258 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":76,"threads_started":1}
I20260810 21:07:18.467676 7785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:18.467377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:56941)
0810 21:07:18.467558 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:18.467602 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":119,"threads_started":1}
I20260810 21:07:18.611410 7787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:18.611172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:41073)
0810 21:07:18.611305 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:18.611350 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":62,"threads_started":1}
I20260810 21:07:18.995818 7789 raft_consensus.cc:482] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:07:18.995994 7789 raft_consensus.cc:504] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:18.996345 7789 leader_election.cc:288] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793), efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575)
Aug 10 21:07:18 dist-test-slave-jq4t krb5kdc[4858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396037, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.2@KRBTEST.COM
Aug 10 21:07:18 dist-test-slave-jq4t krb5kdc[4858](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396037, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.3@KRBTEST.COM
I20260810 21:07:19.008850 7802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:18.996804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:40213 (local address 127.15.37.2:38793)
0810 21:07:18.997020 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:18.997031 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:18.997052 (+ 21us) server_negotiation.cc:407] Connection header received
0810 21:07:18.997524 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:18.997526 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:18.997570 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:18.997685 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:18.998736 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:18.999673 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:19.000799 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:19.001243 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:19.001384 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:19.004038 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:19.004043 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:19.004044 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:19.004055 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:19.006719 (+ 2664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:19.007286 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:19.007291 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:19.007291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:19.007427 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:19.007751 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:19.007752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:19.007752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:19.008085 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:19.008152 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:19.008546 (+ 394us) server_negotiation.cc:299] Negotiation successful
0810 21:07:19.008690 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":77,"threads_started":1}
I20260810 21:07:19.008868 7803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:18.996999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:47879 (local address 127.15.37.3:42575)
0810 21:07:18.997159 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:18.997168 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:18.997205 (+ 37us) server_negotiation.cc:407] Connection header received
0810 21:07:18.997684 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:18.997688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:18.997744 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:18.997901 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:18.998550 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:18.999533 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:19.000799 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:19.001243 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:19.001383 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:19.004555 (+ 3172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:19.004558 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:19.004559 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:19.004570 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:19.007032 (+ 2462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:19.007512 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:19.007516 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:19.007516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:19.007630 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:19.007901 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:19.007902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:19.007902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:19.008183 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:19.008269 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:19.008560 (+ 291us) server_negotiation.cc:299] Negotiation successful
0810 21:07:19.008695 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":70,"threads_started":1}
I20260810 21:07:19.008944 7790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:18.996685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:38793 (local address 127.15.37.1:40213)
0810 21:07:18.996850 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:18.996864 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:18.996924 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:18.997779 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:18.997782 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:18.998213 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:18.998405 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:18.998412 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:18.999787 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:18.999788 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:19.000701 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:19.000704 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:19.001362 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:19.001363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:19.001508 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:19.002216 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:19.002221 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:19.003901 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:19.006854 (+ 2953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:19.006863 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:19.006866 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:19.007188 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:19.007514 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:19.007515 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:19.007515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:19.007674 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:19.008169 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:19.008177 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:19.008331 (+ 154us) client_negotiation.cc:769] Sending connection context
0810 21:07:19.008456 (+ 125us) client_negotiation.cc:240] Negotiation successful
0810 21:07:19.008695 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":115,"thread_start_us":91,"threads_started":1}
I20260810 21:07:19.009089 7799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:18.996679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:42575 (local address 127.15.37.1:47879)
0810 21:07:18.996840 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:18.996852 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:18.996905 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:18.997893 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:18.997895 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:18.998171 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:18.998406 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:18.998414 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:18.999657 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:18.999658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:19.000700 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:19.000703 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:19.001364 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:19.001365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:19.001501 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:19.002205 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:19.002214 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:19.004386 (+ 2172us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:19.007161 (+ 2775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:19.007162 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:19.007163 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:19.007386 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:19.007731 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:19.007732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:19.007732 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:19.007808 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:19.008268 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:19.008269 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:19.008331 (+ 62us) client_negotiation.cc:769] Sending connection context
0810 21:07:19.008464 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 21:07:19.008788 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":146,"thread_start_us":88,"threads_started":1}
W20260810 21:07:19.010036 7118 leader_election.cc:341] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575): Not found: Tablet not found: 11f82abc61b5473cade177d47ef90590
W20260810 21:07:19.010159 7122 leader_election.cc:341] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793): Not found: Tablet not found: 11f82abc61b5473cade177d47ef90590
I20260810 21:07:19.010258 7122 leader_election.cc:302] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0501720b15477591af1ff9b787213a; no voters: 63f8af48bf1a43a9a12865910ef55180, efacecdf73c64b9da9317b726abbee2e
I20260810 21:07:19.010426 7789 raft_consensus.cc:2726] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 21:07:19.425191 7799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:19.425008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:36277)
0810 21:07:19.425090 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:19.425140 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 21:07:19.468783 7805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:19.468430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:51903)
0810 21:07:19.468657 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:19.468721 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":155,"threads_started":1}
I20260810 21:07:19.612368 7806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:19.612077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:37075)
0810 21:07:19.612264 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:19.612314 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":78,"threads_started":1}
I20260810 21:07:20.426136 7810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:20.425819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:48633)
0810 21:07:20.426025 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:20.426079 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":82,"threads_started":1}
I20260810 21:07:20.469666 7811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:20.469363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:51145)
0810 21:07:20.469540 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:20.469591 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":73,"threads_started":1}
I20260810 21:07:20.613253 7813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:20.612973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:55745)
0810 21:07:20.613154 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:20.613200 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":72,"threads_started":1}
I20260810 21:07:21.040781 7814 raft_consensus.cc:482] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:07:21.040931 7814 raft_consensus.cc:504] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:21.041126 7814 leader_election.cc:288] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793), efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575)
W20260810 21:07:21.041662 7118 leader_election.cc:341] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575): Not found: Tablet not found: 11f82abc61b5473cade177d47ef90590
W20260810 21:07:21.041774 7122 leader_election.cc:341] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793): Not found: Tablet not found: 11f82abc61b5473cade177d47ef90590
I20260810 21:07:21.041882 7122 leader_election.cc:302] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0501720b15477591af1ff9b787213a; no voters: 63f8af48bf1a43a9a12865910ef55180, efacecdf73c64b9da9317b726abbee2e
I20260810 21:07:21.041960 7814 raft_consensus.cc:2726] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 21:07:21.427019 7815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:21.426760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:50261)
0810 21:07:21.426909 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:21.426957 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":103,"threads_started":1}
I20260810 21:07:21.470641 7817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:21.470345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:43451)
0810 21:07:21.470508 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:21.470564 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
I20260810 21:07:21.614197 7818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:21.613897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:38793)
0810 21:07:21.614070 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:21.614140 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":71,"threads_started":1}
I20260810 21:07:22.427882 7819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:22.427626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:46335)
0810 21:07:22.427757 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:22.427796 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260810 21:07:22.471517 7822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:22.471217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:55557)
0810 21:07:22.471398 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:22.471445 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":94,"threads_started":1}
I20260810 21:07:22.614984 7827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:22.614696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:36485)
0810 21:07:22.614858 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:22.614908 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":75,"threads_started":1}
I20260810 21:07:23.428961 7829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:23.428709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:57719)
0810 21:07:23.428857 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:23.428907 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":69,"threads_started":1}
I20260810 21:07:23.472267 7832 raft_consensus.cc:482] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:07:23.472431 7832 raft_consensus.cc:504] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:23.472487 7833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:23.472211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:40649)
0810 21:07:23.472361 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:23.472409 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260810 21:07:23.472677 7832 leader_election.cc:288] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793), efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575)
W20260810 21:07:23.473114 7122 leader_election.cc:341] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793): Not found: Tablet not found: 11f82abc61b5473cade177d47ef90590
W20260810 21:07:23.473201 7118 leader_election.cc:341] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575): Not found: Tablet not found: 11f82abc61b5473cade177d47ef90590
I20260810 21:07:23.473285 7118 leader_election.cc:302] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0501720b15477591af1ff9b787213a; no voters: 63f8af48bf1a43a9a12865910ef55180, efacecdf73c64b9da9317b726abbee2e
I20260810 21:07:23.473359 7832 raft_consensus.cc:2726] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 21:07:23.615842 7834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:23.615551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:40091)
0810 21:07:23.615706 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:23.615762 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":67,"threads_started":1}
I20260810 21:07:24.429883 7835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:24.429580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:41845)
0810 21:07:24.429759 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:24.429811 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":111,"threads_started":1}
I20260810 21:07:24.473410 7836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:24.473098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:48989)
0810 21:07:24.473278 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:24.473351 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":80,"threads_started":1}
I20260810 21:07:24.616819 7838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:24.616528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:54451)
0810 21:07:24.616719 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:24.616764 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":100,"threads_started":1}
I20260810 21:07:25.430846 7839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:25.430582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:55013)
0810 21:07:25.430729 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:25.430775 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":75,"threads_started":1}
I20260810 21:07:25.474385 7841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:25.474101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:44807)
0810 21:07:25.474274 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:25.474329 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":95,"threads_started":1}
I20260810 21:07:25.617779 7844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:25.617522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:54063)
0810 21:07:25.617672 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:25.617721 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":73,"threads_started":1}
I20260810 21:07:25.767545 7845 raft_consensus.cc:482] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:07:25.767716 7845 raft_consensus.cc:504] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:25.767979 7845 leader_election.cc:288] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793), efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575)
W20260810 21:07:25.768465 7118 leader_election.cc:341] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575): Not found: Tablet not found: 11f82abc61b5473cade177d47ef90590
W20260810 21:07:25.768573 7122 leader_election.cc:341] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793): Not found: Tablet not found: 11f82abc61b5473cade177d47ef90590
I20260810 21:07:25.768610 7122 leader_election.cc:302] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0501720b15477591af1ff9b787213a; no voters: 63f8af48bf1a43a9a12865910ef55180, efacecdf73c64b9da9317b726abbee2e
I20260810 21:07:25.768699 7845 raft_consensus.cc:2726] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 21:07:26.431885 7846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:26.431557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:34661)
0810 21:07:26.431740 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:26.431797 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":81,"threads_started":1}
I20260810 21:07:26.475107 7848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:26.474874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:43659)
0810 21:07:26.475016 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:26.475055 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":70,"threads_started":1}
I20260810 21:07:26.618705 7849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:26.618418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:37435)
0810 21:07:26.618598 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:26.618647 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":74,"threads_started":1}
I20260810 21:07:27.432871 7850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:27.432616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:53637)
0810 21:07:27.432752 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:27.432801 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":65,"threads_started":1}
I20260810 21:07:27.475994 7855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:27.475710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:46911)
0810 21:07:27.475888 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:27.475937 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":71,"threads_started":1}
I20260810 21:07:27.619781 7859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:27.619497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:47903)
0810 21:07:27.619671 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:27.619721 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":85,"threads_started":1}
I20260810 21:07:28.433573 7861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:28.433351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:43247)
0810 21:07:28.433484 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:28.433520 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
I20260810 21:07:28.476933 7862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:28.476696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:39289)
0810 21:07:28.476837 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:28.476880 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":70,"threads_started":1}
I20260810 21:07:28.480984 7865 raft_consensus.cc:482] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:07:28.481086 7865 raft_consensus.cc:504] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f8af48bf1a43a9a12865910ef55180" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38793 } } peers { permanent_uuid: "efacecdf73c64b9da9317b726abbee2e" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 42575 } } peers { permanent_uuid: "8f0501720b15477591af1ff9b787213a" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 36491 } }
I20260810 21:07:28.481313 7865 leader_election.cc:288] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793), efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575)
W20260810 21:07:28.481747 7122 leader_election.cc:341] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 63f8af48bf1a43a9a12865910ef55180 (127.15.37.2:38793): Not found: Tablet not found: 11f82abc61b5473cade177d47ef90590
W20260810 21:07:28.481850 7118 leader_election.cc:341] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer efacecdf73c64b9da9317b726abbee2e (127.15.37.3:42575): Not found: Tablet not found: 11f82abc61b5473cade177d47ef90590
I20260810 21:07:28.481938 7118 leader_election.cc:302] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8f0501720b15477591af1ff9b787213a; no voters: 63f8af48bf1a43a9a12865910ef55180, efacecdf73c64b9da9317b726abbee2e
I20260810 21:07:28.482018 7865 raft_consensus.cc:2726] T 11f82abc61b5473cade177d47ef90590 P 8f0501720b15477591af1ff9b787213a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 21:07:28.620951 7866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:28.620626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:37977)
0810 21:07:28.620843 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:28.620886 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":125,"threads_started":1}
I20260810 21:07:29.434370 7870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:29.434109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:42829)
0810 21:07:29.434272 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:29.434318 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":69,"threads_started":1}
I20260810 21:07:29.477823 7872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:29.477536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:57083)
0810 21:07:29.477721 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:29.477767 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":90,"threads_started":1}
I20260810 21:07:29.621752 7873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:29.621500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:47333)
0810 21:07:29.621650 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:29.621696 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":78,"threads_started":1}
I20260810 21:07:30.435205 7874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:30.434951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:44117)
0810 21:07:30.435108 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:30.435154 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":76,"threads_started":1}
I20260810 21:07:30.478718 7876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:30.478468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:60367)
0810 21:07:30.478622 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:30.478661 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260810 21:07:30.622632 7878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:30.622346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:37793)
0810 21:07:30.622520 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:30.622576 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":80,"threads_started":1}
I20260810 21:07:31.436071 7879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:31.435776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:42737)
0810 21:07:31.435963 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:31.436015 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":74,"threads_started":1}
I20260810 21:07:31.479732 7881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:31.479450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:60769)
0810 21:07:31.479625 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:31.479676 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":81,"threads_started":1}
I20260810 21:07:31.623565 7883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:31.623311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:51937)
0810 21:07:31.623465 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:31.623508 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":73,"threads_started":1}
I20260810 21:07:32.437069 7888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:32.436768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.1:49009)
0810 21:07:32.436969 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:32.437011 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":119,"threads_started":1}
I20260810 21:07:32.481073 7891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:32.480782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.2:34839)
0810 21:07:32.480966 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:32.481014 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":92,"threads_started":1}
I20260810 21:07:32.624719 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 7042
I20260810 21:07:32.633119 7892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:32.624359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46557 (local address 127.15.37.3:52899)
0810 21:07:32.624574 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:32.624613 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:46557: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":125,"threads_started":1}
I20260810 21:07:32.640065 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 7319
I20260810 21:07:32.654422 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 7545
2026-08-10T21:07:32Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19177 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:07:32 dist-test-slave-jq4t krb5kdc[7901](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:07:32 dist-test-slave-jq4t krb5kdc[7901](info): set up 2 sockets
Aug 10 21:07:32 dist-test-slave-jq4t krb5kdc[7901](info): commencing operation
krb5kdc: starting...
W20260810 21:07:33.934355 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:07:34 dist-test-slave-jq4t krb5kdc[7901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:07:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:07:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:07:34.069993 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39625
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:39625
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:34.157210 7920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:34.157481 7920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:34.157521 7920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:34.158713 7920 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 21:07:34.158792 7920 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 21:07:34.158813 7920 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 21:07:34.158833 7920 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:07:34.158864 7920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:34.158895 7920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:34.158921 7920 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:07:34.158949 7920 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:07:34.160604 7920 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:39625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:34.160938 7920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:34.161201 7920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:34.166673 7926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:34.166708 7932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:34.166680 7925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:34.167055 7920 server_base.cc:1034] running on GCE node
I20260810 21:07:34.167374 7920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:34.167755 7920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:34.171068 7920 hybrid_clock.cc:648] HybridClock initialized: now 1786396054171030 us; error 44 us; skew 500 ppm
Aug 10 21:07:34 dist-test-slave-jq4t krb5kdc[7901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:34.174039 7920 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:07:34.174564 7920 webserver.cc:460] Webserver started at http://127.15.37.62:43719/ using document root <none> and password file <none>
I20260810 21:07:34.174842 7920 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:34.174919 7920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:34.175081 7920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:07:34.176239 7920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "09d44c6a9719457d81a8eeccc77298c3"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "156879796c27e04d97ed2042265c381a"
server_key_iv: "fdb5ddfe29ad3e7c98a3a4029e90fe4e"
server_key_version: "encryptionkey@0"
I20260810 21:07:34.176656 7920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "09d44c6a9719457d81a8eeccc77298c3"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "156879796c27e04d97ed2042265c381a"
server_key_iv: "fdb5ddfe29ad3e7c98a3a4029e90fe4e"
server_key_version: "encryptionkey@0"
I20260810 21:07:34.178122 7920 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:34.178974 7945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:34.179203 7920 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:34.179322 7920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "09d44c6a9719457d81a8eeccc77298c3"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "156879796c27e04d97ed2042265c381a"
server_key_iv: "fdb5ddfe29ad3e7c98a3a4029e90fe4e"
server_key_version: "encryptionkey@0"
I20260810 21:07:34.179414 7920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:34.192912 7920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:34.195029 7920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:34.195220 7920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:34.199834 7920 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:39625
I20260810 21:07:34.199877 8029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:39625 every 8 connection(s)
I20260810 21:07:34.200323 7920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:07:34.201342 8030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:34.203732 8030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Bootstrap starting.
I20260810 21:07:34.204355 8030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:34.204712 8030 log.cc:824] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:34.205431 8030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: No bootstrap required, opened a new log
I20260810 21:07:34.206487 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 7920
I20260810 21:07:34.206635 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:07:34.206854 15508 external_mini_cluster.cc:1428] Setting key 3f425353460dca67bdc70a680c761230
I20260810 21:07:34.207341 8030 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } }
I20260810 21:07:34.207593 8030 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:34.207643 8030 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09d44c6a9719457d81a8eeccc77298c3, State: Initialized, Role: FOLLOWER
I20260810 21:07:34.207813 8030 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } }
I20260810 21:07:34.207906 8030 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:07:34.207931 8030 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:07:34.207998 8030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:34.209302 8030 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } }
I20260810 21:07:34.209404 8030 leader_election.cc:302] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09d44c6a9719457d81a8eeccc77298c3; no voters:
I20260810 21:07:34.209596 8030 leader_election.cc:288] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:07:34.209632 8035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:07:34.209748 8035 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 1 LEADER]: Becoming Leader. State: Replica: 09d44c6a9719457d81a8eeccc77298c3, State: Running, Role: LEADER
I20260810 21:07:34.209895 8030 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:07:34.209928 8035 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } }
I20260810 21:07:34.210371 8035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09d44c6a9719457d81a8eeccc77298c3. Latest consensus state: current_term: 1 leader_uuid: "09d44c6a9719457d81a8eeccc77298c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } } }
I20260810 21:07:34.210379 8037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09d44c6a9719457d81a8eeccc77298c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } } }
I20260810 21:07:34.210672 8035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:34.210682 8037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:34.210995 8048 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:07:34.211871 8048 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:07:34.214562 8048 catalog_manager.cc:1347] Generated new cluster ID: 9280188fb3124b1297f097346a943f0c
I20260810 21:07:34.214627 8048 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:07:34 dist-test-slave-jq4t krb5kdc[7901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396054, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:34.219095 8034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.207476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43502 (local address 127.15.37.62:39625)
0810 21:07:34.207817 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:34.207828 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:34.207864 (+ 36us) server_negotiation.cc:407] Connection header received
0810 21:07:34.208021 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:34.208030 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:34.208097 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:34.208228 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:34.209201 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.210624 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.211822 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.212435 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.212626 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.215551 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:34.215555 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:34.215556 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:34.215582 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:34.217441 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:34.217846 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:34.217850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:34.217850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:34.217967 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:34.218188 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:34.218190 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:34.218190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:34.218461 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:34.218617 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:34.218722 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 21:07:34.218877 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":118,"threads_started":1}
I20260810 21:07:34.236418 8048 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:07:34.237097 8048 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:07:34.239651 8048 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Generated new TSK 0
I20260810 21:07:34.239883 8048 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:07:34.283444 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:39625
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:34.384454 8069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:34.384750 8069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:34.384778 8069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:34.385995 8069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:34.386049 8069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:34.386077 8069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:07:34.387631 8069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:39625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:34.387924 8069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:34.388203 8069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:34.393918 8084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:34.393927 8077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:34.393973 8069 server_base.cc:1034] running on GCE node
W20260810 21:07:34.393927 8079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:34.394383 8069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:34.394695 8069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:34.395884 8069 hybrid_clock.cc:648] HybridClock initialized: now 1786396054395869 us; error 30 us; skew 500 ppm
Aug 10 21:07:34 dist-test-slave-jq4t krb5kdc[7901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:34.398765 8069 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:07:34.399322 8069 webserver.cc:460] Webserver started at http://127.15.37.1:45315/ using document root <none> and password file <none>
I20260810 21:07:34.399595 8069 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:34.399667 8069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:34.399824 8069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:07:34.401079 8069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "178f33c315554588ad48b5b3dbb4b228"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "d3da30552f09d6a369082821a2116b89"
server_key_iv: "a0a1a7abf2e4d7a577391d7ae2119cf8"
server_key_version: "encryptionkey@0"
I20260810 21:07:34.401456 8069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "178f33c315554588ad48b5b3dbb4b228"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "d3da30552f09d6a369082821a2116b89"
server_key_iv: "a0a1a7abf2e4d7a577391d7ae2119cf8"
server_key_version: "encryptionkey@0"
I20260810 21:07:34.402904 8069 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 21:07:34.403762 8093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:34.403977 8069 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:34.404103 8069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "178f33c315554588ad48b5b3dbb4b228"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "d3da30552f09d6a369082821a2116b89"
server_key_iv: "a0a1a7abf2e4d7a577391d7ae2119cf8"
server_key_version: "encryptionkey@0"
I20260810 21:07:34.404186 8069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:34.415376 8069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:34.417647 8069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:34.417829 8069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:34.418090 8069 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:34.418437 8069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:34.418494 8069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:34.418531 8069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:34.418565 8069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:34.425108 8069 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:46057
I20260810 21:07:34.425161 8305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:46057 every 8 connection(s)
I20260810 21:07:34.425514 8069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:07:34.430975 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 8069
I20260810 21:07:34.431123 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:07:34.431345 15508 external_mini_cluster.cc:1428] Setting key f9f01a7f0523fc894322020b883b41a3
Aug 10 21:07:34 dist-test-slave-jq4t krb5kdc[7901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:34.436890 8034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.426289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:55575 (local address 127.15.37.62:39625)
0810 21:07:34.426340 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:34.426342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:34.426613 (+ 271us) server_negotiation.cc:407] Connection header received
0810 21:07:34.427223 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:34.427224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:34.427241 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:34.427296 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:34.428343 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.428930 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.429994 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.430223 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.430305 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.433344 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:34.433346 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:34.433347 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:34.433357 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:34.435147 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:34.435719 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:34.435720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:34.435720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:34.435781 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:34.436132 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:34.436133 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:34.436133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:34.436257 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:34.436311 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:34.436736 (+ 425us) server_negotiation.cc:299] Negotiation successful
0810 21:07:34.436818 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 21:07:34.437250 8310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.426271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:55575)
0810 21:07:34.426476 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:34.426514 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:34.427103 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:34.427369 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:34.427373 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:34.428011 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:34.428224 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:34.428229 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.429033 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.429034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:34.429893 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:34.429895 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.430316 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.430317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:34.430468 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.431220 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:34.431230 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:34.433231 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:34.435270 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:34.435279 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:34.435282 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:34.435622 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:34.435886 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:34.435887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:34.435888 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:34.436060 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:34.436328 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:34.436337 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:34.436582 (+ 245us) client_negotiation.cc:769] Sending connection context
0810 21:07:34.436710 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 21:07:34.436932 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":107,"threads_started":1}
I20260810 21:07:34.437912 8306 heartbeater.cc:347] Connected to a master server at 127.15.37.62:39625
I20260810 21:07:34.438043 8306 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:34.438263 8306 heartbeater.cc:511] Master 127.15.37.62:39625 requested a full tablet report, sending...
I20260810 21:07:34.438970 7970 ts_manager.cc:194] Registered new tserver with Master: 178f33c315554588ad48b5b3dbb4b228 (127.15.37.1:46057)
I20260810 21:07:34.440045 7970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:55575
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:07:34.463392 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:39625
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:34.549656 8314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:34.549899 8314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:34.549943 8314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:34.551205 8314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:34.551285 8314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:34.551331 8314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:07:34.552925 8314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:39625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:34.553205 8314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:34.553448 8314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:34.558806 8322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:34.558826 8328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:34.558888 8324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:34.559108 8314 server_base.cc:1034] running on GCE node
I20260810 21:07:34.559340 8314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:34.559610 8314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:34.560781 8314 hybrid_clock.cc:648] HybridClock initialized: now 1786396054560751 us; error 49 us; skew 500 ppm
Aug 10 21:07:34 dist-test-slave-jq4t krb5kdc[7901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:34.563503 8314 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:07:34.564031 8314 webserver.cc:460] Webserver started at http://127.15.37.2:38417/ using document root <none> and password file <none>
I20260810 21:07:34.564275 8314 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:34.564345 8314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:34.564538 8314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:07:34.565661 8314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "d7b8260706254935bc95b955915d16b2"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "962ac0476be6e6212b8410cbef5b0235"
server_key_iv: "04a0d7d5fd0a88a869d1b2301f67015a"
server_key_version: "encryptionkey@0"
I20260810 21:07:34.566048 8314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "d7b8260706254935bc95b955915d16b2"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "962ac0476be6e6212b8410cbef5b0235"
server_key_iv: "04a0d7d5fd0a88a869d1b2301f67015a"
server_key_version: "encryptionkey@0"
I20260810 21:07:34.567464 8314 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:07:34.568243 8346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:34.568445 8314 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:07:34.568579 8314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "d7b8260706254935bc95b955915d16b2"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "962ac0476be6e6212b8410cbef5b0235"
server_key_iv: "04a0d7d5fd0a88a869d1b2301f67015a"
server_key_version: "encryptionkey@0"
I20260810 21:07:34.568665 8314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:34.590540 8314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:34.592629 8314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:34.592813 8314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:34.593087 8314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:34.593505 8314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:34.593595 8314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:34.593641 8314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:34.593660 8314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:34.600816 8314 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:37645
I20260810 21:07:34.600860 8550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:37645 every 8 connection(s)
I20260810 21:07:34.601239 8314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
Aug 10 21:07:34 dist-test-slave-jq4t krb5kdc[7901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:34.609794 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 8314
I20260810 21:07:34.609948 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:07:34.610198 15508 external_mini_cluster.cc:1428] Setting key bc00ea6d41cccc0b01ae3ae1c571281f
I20260810 21:07:34.612210 8034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.602124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:39845 (local address 127.15.37.62:39625)
0810 21:07:34.602257 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:34.602259 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:34.602454 (+ 195us) server_negotiation.cc:407] Connection header received
0810 21:07:34.603057 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:34.603058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:34.603072 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:34.603125 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:34.604203 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.604804 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.605892 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.606099 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.606184 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.608732 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:34.608734 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:34.608735 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:34.608743 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:34.610344 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:34.610912 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:34.610913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:34.610914 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:34.610986 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:34.611311 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:34.611312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:34.611313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:34.611512 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:34.611633 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:34.611957 (+ 324us) server_negotiation.cc:299] Negotiation successful
0810 21:07:34.612069 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260810 21:07:34.612396 8555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.602042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:39845)
0810 21:07:34.602289 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:34.602347 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:34.602927 (+ 580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:34.603205 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:34.603209 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:34.603850 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:34.604074 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:34.604079 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.604934 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.604935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:34.605788 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:34.605790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.606194 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.606196 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:34.606345 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.606983 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:34.607001 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:34.608627 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:34.610463 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:34.610471 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:34.610474 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:34.610799 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:34.611074 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:34.611075 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:34.611075 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:34.611195 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:34.611625 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:34.611633 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:34.611798 (+ 165us) client_negotiation.cc:769] Sending connection context
0810 21:07:34.611917 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 21:07:34.612065 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":100,"threads_started":1}
I20260810 21:07:34.612982 8553 heartbeater.cc:347] Connected to a master server at 127.15.37.62:39625
I20260810 21:07:34.613116 8553 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:34.613312 8553 heartbeater.cc:511] Master 127.15.37.62:39625 requested a full tablet report, sending...
I20260810 21:07:34.613686 7970 ts_manager.cc:194] Registered new tserver with Master: d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645)
I20260810 21:07:34.614100 7970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:39845
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:07:34.638832 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:39625
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:34.726305 8562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:34.726534 8562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:34.726558 8562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:34.727731 8562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:34.727779 8562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:34.727805 8562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:07:34.729445 8562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:39625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:34.729712 8562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:34.729962 8562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:34.735370 8569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:34.735430 8574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:34.735435 8568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:34.735841 8562 server_base.cc:1034] running on GCE node
I20260810 21:07:34.736053 8562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:34.736294 8562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:34.737440 8562 hybrid_clock.cc:648] HybridClock initialized: now 1786396054737424 us; error 40 us; skew 500 ppm
Aug 10 21:07:34 dist-test-slave-jq4t krb5kdc[7901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:34.740257 8562 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:07:34.740772 8562 webserver.cc:460] Webserver started at http://127.15.37.3:45967/ using document root <none> and password file <none>
I20260810 21:07:34.741089 8562 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:34.741142 8562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:34.741279 8562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:07:34.742425 8562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "f0aee42985f14a5fb13079e2582cd08b"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "d08c837d4dc5491f4c089f54277542a4"
server_key_iv: "afa4b96f1433ab7c1ad92793a29a995e"
server_key_version: "encryptionkey@0"
I20260810 21:07:34.742813 8562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "f0aee42985f14a5fb13079e2582cd08b"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "d08c837d4dc5491f4c089f54277542a4"
server_key_iv: "afa4b96f1433ab7c1ad92793a29a995e"
server_key_version: "encryptionkey@0"
I20260810 21:07:34.744279 8562 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:07:34.745216 8587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:34.745447 8562 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:07:34.745767 8562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "f0aee42985f14a5fb13079e2582cd08b"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "d08c837d4dc5491f4c089f54277542a4"
server_key_iv: "afa4b96f1433ab7c1ad92793a29a995e"
server_key_version: "encryptionkey@0"
I20260810 21:07:34.745877 8562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:34.755486 8562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:34.758109 8562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:34.758296 8562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:34.758564 8562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:34.758910 8562 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:34.758967 8562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:34.759013 8562 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:34.759052 8562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:34.765699 8562 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:41977
I20260810 21:07:34.765790 8780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:41977 every 8 connection(s)
I20260810 21:07:34.766394 8562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
Aug 10 21:07:34 dist-test-slave-jq4t krb5kdc[7901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396054, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:34.775574 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 8562
I20260810 21:07:34.775704 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:07:34.775915 15508 external_mini_cluster.cc:1428] Setting key faa6a95767ef63356622b57e0d5f688e
I20260810 21:07:34.776971 8034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.767351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:49817 (local address 127.15.37.62:39625)
0810 21:07:34.767435 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:34.767436 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:34.767647 (+ 211us) server_negotiation.cc:407] Connection header received
0810 21:07:34.768154 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:34.768156 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:34.768169 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:34.768239 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:34.769405 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.769948 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.771003 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.771190 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.771249 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.773761 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:34.773763 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:34.773763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:34.773770 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:34.775146 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:34.775641 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:34.775642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:34.775643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:34.775723 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:34.776065 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:34.776066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:34.776067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:34.776257 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:34.776353 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:34.776774 (+ 421us) server_negotiation.cc:299] Negotiation successful
0810 21:07:34.776875 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 21:07:34.777210 8785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.767266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:49817)
0810 21:07:34.767471 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:34.767527 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:34.768057 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:34.768326 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:34.768330 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:34.769087 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:34.769307 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:34.769313 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.770045 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.770045 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:34.770915 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:34.770918 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.771274 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.771275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:34.771384 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.772100 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:34.772109 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:34.773659 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:34.775259 (+ 1600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:34.775268 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:34.775270 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:34.775552 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:34.775823 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:34.775824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:34.775825 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:34.775992 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:34.776342 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:34.776350 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:34.776595 (+ 245us) client_negotiation.cc:769] Sending connection context
0810 21:07:34.776733 (+ 138us) client_negotiation.cc:240] Negotiation successful
0810 21:07:34.776929 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
I20260810 21:07:34.777667 8781 heartbeater.cc:347] Connected to a master server at 127.15.37.62:39625
I20260810 21:07:34.777758 8781 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:34.777979 8781 heartbeater.cc:511] Master 127.15.37.62:39625 requested a full tablet report, sending...
I20260810 21:07:34.778476 7970 ts_manager.cc:194] Registered new tserver with Master: f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977)
I20260810 21:07:34.778893 7970 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:49817
I20260810 21:07:34.788234 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:07:34.796308 8034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.789884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43504 (local address 127.15.37.62:39625)
0810 21:07:34.789958 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:34.789959 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:34.790008 (+ 49us) server_negotiation.cc:407] Connection header received
0810 21:07:34.790105 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:34.790106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:34.790119 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:34.790204 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:34.790782 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.791307 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.792099 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.792297 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.792362 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.793742 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:34.793743 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:34.793744 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:34.793750 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:34.795267 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:34.795611 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:34.795612 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:34.795612 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:34.795667 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:34.795842 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:34.795843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:34.795843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:34.796000 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:34.796077 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:34.796173 (+ 96us) server_negotiation.cc:299] Negotiation successful
0810 21:07:34.796237 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 21:07:34.798203 7970 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43504:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:07:34.800002 7970 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:07:34.807749 8803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.803612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:46057 (local address 127.0.0.1:33970)
0810 21:07:34.803793 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:34.803806 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:34.803863 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:34.804117 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:34.804117 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:34.804120 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:34.804170 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:34.804171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.805170 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.805172 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:34.806606 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:34.806610 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.807403 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.807404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:34.807503 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.807526 (+ 23us) client_negotiation.cc:769] Sending connection context
0810 21:07:34.807597 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 21:07:34.807657 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":42,"thread_start_us":85,"threads_started":1}
I20260810 21:07:34.807889 8801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.803421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:37645 (local address 127.0.0.1:54444)
0810 21:07:34.803753 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:34.803764 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:34.804141 (+ 377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:34.804374 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:34.804375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:34.804377 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:34.804419 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:34.804421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.805615 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.805616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:34.806699 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:34.806702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.807624 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.807625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:34.807720 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.807724 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:07:34.807776 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 21:07:34.807820 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":83,"threads_started":1}
I20260810 21:07:34.807960 8802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.803578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54444 (local address 127.15.37.2:37645)
0810 21:07:34.804000 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:34.804003 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:34.804014 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:07:34.804255 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:34.804258 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:34.804275 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:34.804352 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:34.804509 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.805506 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.806778 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.807506 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.807578 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.807638 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:34.807820 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 21:07:34.807864 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":113,"threads_started":1}
I20260810 21:07:34.808190 8799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.803157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:41977 (local address 127.0.0.1:34276)
0810 21:07:34.803332 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:34.803365 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:34.803470 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:34.803849 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:34.803852 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:34.803855 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:34.803955 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:34.803958 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.805369 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.805370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:34.806632 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:34.806635 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.807649 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.807650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:34.807717 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.807721 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:07:34.807792 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 21:07:34.807843 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":30,"thread_start_us":103,"threads_started":1}
I20260810 21:07:34.808373 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.803745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33970 (local address 127.15.37.1:46057)
0810 21:07:34.803964 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:34.803968 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:34.803979 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:07:34.804024 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:34.804026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:34.804041 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:34.804116 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:34.804229 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.805062 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.806690 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.807312 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.807403 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.807473 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:34.808212 (+ 739us) server_negotiation.cc:299] Negotiation successful
0810 21:07:34.808266 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":93,"threads_started":1}
I20260810 21:07:34.808764 8800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:34.803290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34276 (local address 127.15.37.3:41977)
0810 21:07:34.803558 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:34.803564 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:34.803575 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:07:34.803624 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:34.803626 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:34.803644 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:34.803734 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:34.804045 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.805262 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.806726 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:34.807506 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:34.807580 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:34.808602 (+ 1022us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:34.808632 (+ 30us) server_negotiation.cc:299] Negotiation successful
0810 21:07:34.808677 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":106,"threads_started":1}
I20260810 21:07:34.808805 8441 tablet_service.cc:1467] Processing CreateTablet for tablet 344d6a11242844bdad74d9c1a123ab7e (DEFAULT_TABLE table=test-table [id=08bb5d9db7534d73a04142f753f1a48b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:34.809042 8183 tablet_service.cc:1467] Processing CreateTablet for tablet 344d6a11242844bdad74d9c1a123ab7e (DEFAULT_TABLE table=test-table [id=08bb5d9db7534d73a04142f753f1a48b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:34.809247 8441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 344d6a11242844bdad74d9c1a123ab7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:34.809415 8183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 344d6a11242844bdad74d9c1a123ab7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:34.809418 8669 tablet_service.cc:1467] Processing CreateTablet for tablet 344d6a11242844bdad74d9c1a123ab7e (DEFAULT_TABLE table=test-table [id=08bb5d9db7534d73a04142f753f1a48b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:34.809724 8669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 344d6a11242844bdad74d9c1a123ab7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:34.812644 8806 tablet_bootstrap.cc:492] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Bootstrap starting.
I20260810 21:07:34.812829 8808 tablet_bootstrap.cc:492] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2: Bootstrap starting.
I20260810 21:07:34.813271 8815 tablet_bootstrap.cc:492] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b: Bootstrap starting.
I20260810 21:07:34.813421 8806 tablet_bootstrap.cc:654] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:34.813421 8808 tablet_bootstrap.cc:654] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:34.813943 8815 tablet_bootstrap.cc:654] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:34.814123 8808 log.cc:824] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:34.814137 8806 log.cc:824] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:34.814580 8815 log.cc:824] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:34.814980 8806 tablet_bootstrap.cc:492] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: No bootstrap required, opened a new log
I20260810 21:07:34.815076 8806 ts_tablet_manager.cc:1397] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:07:34.815435 8808 tablet_bootstrap.cc:492] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2: No bootstrap required, opened a new log
I20260810 21:07:34.815451 8815 tablet_bootstrap.cc:492] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b: No bootstrap required, opened a new log
I20260810 21:07:34.815519 8815 ts_tablet_manager.cc:1397] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:07:34.815519 8808 ts_tablet_manager.cc:1397] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:07:34.816752 8806 raft_consensus.cc:348] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:34.816923 8806 raft_consensus.cc:374] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:34.816987 8806 raft_consensus.cc:729] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f33c315554588ad48b5b3dbb4b228, State: Initialized, Role: FOLLOWER
I20260810 21:07:34.817121 8806 consensus_queue.cc:260] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:34.817435 8306 heartbeater.cc:503] Master 127.15.37.62:39625 was elected leader, sending a full tablet report...
I20260810 21:07:34.817440 8806 ts_tablet_manager.cc:1428] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 21:07:34.817592 8808 raft_consensus.cc:348] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:34.817592 8815 raft_consensus.cc:348] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:34.817777 8808 raft_consensus.cc:374] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:34.817777 8815 raft_consensus.cc:374] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:34.817823 8815 raft_consensus.cc:729] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0aee42985f14a5fb13079e2582cd08b, State: Initialized, Role: FOLLOWER
I20260810 21:07:34.817864 8808 raft_consensus.cc:729] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7b8260706254935bc95b955915d16b2, State: Initialized, Role: FOLLOWER
I20260810 21:07:34.817965 8815 consensus_queue.cc:260] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:34.818041 8808 consensus_queue.cc:260] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:34.818264 8815 ts_tablet_manager.cc:1428] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:07:34.818320 8808 ts_tablet_manager.cc:1428] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:07:34.818473 8553 heartbeater.cc:503] Master 127.15.37.62:39625 was elected leader, sending a full tablet report...
I20260810 21:07:34.818470 8781 heartbeater.cc:503] Master 127.15.37.62:39625 was elected leader, sending a full tablet report...
W20260810 21:07:34.851879 8554 tablet.cc:2369] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:07:34.926328 8308 tablet.cc:2369] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:07:35.015775 8822 raft_consensus.cc:482] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:07:35.015934 8822 raft_consensus.cc:504] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:35.016350 8822 leader_election.cc:288] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977), d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645)
W20260810 21:07:35.017144 8784 tablet.cc:2369] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:07:35.020193 8800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:35.016736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:53569 (local address 127.15.37.3:41977)
0810 21:07:35.016819 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:35.016820 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:35.016914 (+ 94us) server_negotiation.cc:407] Connection header received
0810 21:07:35.016987 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:35.016989 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:35.017003 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:35.017062 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:35.017321 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:35.017860 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:35.019392 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:35.019798 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:35.019859 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:35.019869 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:35.020065 (+ 196us) server_negotiation.cc:299] Negotiation successful
0810 21:07:35.020126 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 21:07:35.020193 8826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:35.016665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:41977 (local address 127.15.37.1:53569)
0810 21:07:35.016816 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:35.016829 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:35.016902 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:35.017130 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:35.017132 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:35.017150 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:35.017234 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:35.017236 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:35.017945 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:35.017946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:35.019297 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:35.019301 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:35.019900 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:35.019901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:35.019981 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:35.019987 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 21:07:35.020037 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 21:07:35.020074 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":48,"thread_start_us":97,"threads_started":1}
I20260810 21:07:35.020272 8802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:35.017041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:50401 (local address 127.15.37.2:37645)
0810 21:07:35.017091 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:35.017093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:35.017105 (+ 12us) server_negotiation.cc:407] Connection header received
0810 21:07:35.017177 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:35.017178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:35.017191 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:35.017249 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:35.017458 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:35.017950 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:35.019428 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:35.019831 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:35.019931 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:35.019943 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:35.020146 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 21:07:35.020196 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 21:07:35.020285 8827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:35.016923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:37645 (local address 127.15.37.1:50401)
0810 21:07:35.017055 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:35.017066 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:35.017116 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:35.017299 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:35.017300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:35.017301 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:35.017361 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:35.017363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:35.018051 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:35.018052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:35.019298 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:35.019301 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:35.019958 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:35.019959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:35.020047 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:35.020052 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:07:35.020115 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 21:07:35.020159 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":48,"thread_start_us":68,"threads_started":1}
I20260810 21:07:35.020900 8475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "344d6a11242844bdad74d9c1a123ab7e" candidate_uuid: "178f33c315554588ad48b5b3dbb4b228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b8260706254935bc95b955915d16b2" is_pre_election: true
I20260810 21:07:35.020924 8703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "344d6a11242844bdad74d9c1a123ab7e" candidate_uuid: "178f33c315554588ad48b5b3dbb4b228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0aee42985f14a5fb13079e2582cd08b" is_pre_election: true
I20260810 21:07:35.021081 8475 raft_consensus.cc:2454] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f33c315554588ad48b5b3dbb4b228 in term 0.
I20260810 21:07:35.021086 8703 raft_consensus.cc:2454] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 178f33c315554588ad48b5b3dbb4b228 in term 0.
I20260810 21:07:35.021337 8101 leader_election.cc:302] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f33c315554588ad48b5b3dbb4b228, f0aee42985f14a5fb13079e2582cd08b; no voters:
I20260810 21:07:35.021481 8822 raft_consensus.cc:2781] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:07:35.021574 8822 raft_consensus.cc:482] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:07:35.021612 8822 raft_consensus.cc:3037] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:35.022388 8822 raft_consensus.cc:504] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:35.022552 8822 leader_election.cc:288] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 1 election: Requested vote from peers f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977), d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645)
I20260810 21:07:35.022807 8703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "344d6a11242844bdad74d9c1a123ab7e" candidate_uuid: "178f33c315554588ad48b5b3dbb4b228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0aee42985f14a5fb13079e2582cd08b"
I20260810 21:07:35.022814 8475 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "344d6a11242844bdad74d9c1a123ab7e" candidate_uuid: "178f33c315554588ad48b5b3dbb4b228" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7b8260706254935bc95b955915d16b2"
I20260810 21:07:35.022908 8475 raft_consensus.cc:3037] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:35.022912 8703 raft_consensus.cc:3037] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:35.023679 8703 raft_consensus.cc:2454] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f33c315554588ad48b5b3dbb4b228 in term 1.
I20260810 21:07:35.023703 8475 raft_consensus.cc:2454] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 178f33c315554588ad48b5b3dbb4b228 in term 1.
I20260810 21:07:35.023876 8101 leader_election.cc:302] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f33c315554588ad48b5b3dbb4b228, f0aee42985f14a5fb13079e2582cd08b; no voters:
I20260810 21:07:35.023986 8822 raft_consensus.cc:2781] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:07:35.024183 8822 raft_consensus.cc:686] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 1 LEADER]: Becoming Leader. State: Replica: 178f33c315554588ad48b5b3dbb4b228, State: Running, Role: LEADER
I20260810 21:07:35.024302 8822 consensus_queue.cc:237] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:35.025357 7969 catalog_manager.cc:5495] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 reported cstate change: term changed from 0 to 1, leader changed from <none> to 178f33c315554588ad48b5b3dbb4b228 (127.15.37.1). New cstate: current_term: 1 leader_uuid: "178f33c315554588ad48b5b3dbb4b228" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } health_report { overall_health: HEALTHY } } }
I20260810 21:07:35.036304 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:35.033728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33980 (local address 127.15.37.1:46057)
0810 21:07:35.033803 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:35.033805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:35.033816 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:07:35.033871 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:35.033872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:35.033894 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:35.033977 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:07:35.034145 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:35.034644 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:35.035450 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:35.035669 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:35.035752 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:35.035936 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:07:35.036058 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:07:35.036160 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:35.036178 (+ 18us) server_negotiation.cc:299] Negotiation successful
0810 21:07:35.036198 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 21:07:35.038581 8475 raft_consensus.cc:1261] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2 [term 1 FOLLOWER]: Refusing update from remote peer 178f33c315554588ad48b5b3dbb4b228: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:07:35.038580 8703 raft_consensus.cc:1261] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b [term 1 FOLLOWER]: Refusing update from remote peer 178f33c315554588ad48b5b3dbb4b228: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:07:35.039017 8822 consensus_queue.cc:1035] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:07:35.039181 8829 consensus_queue.cc:1035] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:07:35.042308 8839 mvcc.cc:205] Tried to move back new op lower bound from 7317078241434157056 to 7317078241380384768. Current Snapshot: MvccSnapshot[applied={T|T < 7317078241434157056}]
I20260810 21:07:35.044837 7969 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:07:35.044953 7969 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:07:35.045821 7969 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Sending DeleteTablet for 3 replicas of tablet 344d6a11242844bdad74d9c1a123ab7e
I20260810 21:07:35.046223 8183 tablet_service.cc:1514] Processing DeleteTablet for tablet 344d6a11242844bdad74d9c1a123ab7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:35 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:33970
I20260810 21:07:35.046257 8669 tablet_service.cc:1514] Processing DeleteTablet for tablet 344d6a11242844bdad74d9c1a123ab7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:35 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:34276
I20260810 21:07:35.046517 8441 tablet_service.cc:1514] Processing DeleteTablet for tablet 344d6a11242844bdad74d9c1a123ab7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:35 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:54444
I20260810 21:07:35.046780 8852 tablet_replica.cc:330] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2: stopping tablet replica
I20260810 21:07:35.046795 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 8069
I20260810 21:07:35.046898 8852 raft_consensus.cc:2229] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:07:35.047003 8852 raft_consensus.cc:2258] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:07:35.058866 8852 ts_tablet_manager.cc:1905] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:07:35.061933 8852 ts_tablet_manager.cc:1918] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:07:35.062036 8852 log.cc:1196] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/344d6a11242844bdad74d9c1a123ab7e
I20260810 21:07:35.062309 8852 ts_tablet_manager.cc:1939] T 344d6a11242844bdad74d9c1a123ab7e P d7b8260706254935bc95b955915d16b2: Deleting consensus metadata
I20260810 21:07:35.062901 7949 catalog_manager.cc:4841] TS d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645): tablet 344d6a11242844bdad74d9c1a123ab7e (table test-table [id=08bb5d9db7534d73a04142f753f1a48b]) successfully deleted
I20260810 21:07:35.067067 8850 tablet_replica.cc:330] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b: stopping tablet replica
I20260810 21:07:35.067333 8850 raft_consensus.cc:2229] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:07:35.067539 8850 raft_consensus.cc:2258] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:07:35.068253 8850 ts_tablet_manager.cc:1905] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:07:35.069933 8850 ts_tablet_manager.cc:1918] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:07:35.070036 8850 log.cc:1196] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/344d6a11242844bdad74d9c1a123ab7e
I20260810 21:07:35.070338 8850 ts_tablet_manager.cc:1939] T 344d6a11242844bdad74d9c1a123ab7e P f0aee42985f14a5fb13079e2582cd08b: Deleting consensus metadata
I20260810 21:07:35.070910 7949 catalog_manager.cc:4841] TS f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977): tablet 344d6a11242844bdad74d9c1a123ab7e (table test-table [id=08bb5d9db7534d73a04142f753f1a48b]) successfully deleted
W20260810 21:07:35.072958 7949 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:46057 (error 108)
I20260810 21:07:35.073196 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 8314
I20260810 21:07:35.076634 8799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:35.076440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:46057 (local address 127.0.0.1:33988)
0810 21:07:35.076525 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:35.076581 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:46057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260810 21:07:35.081040 7949 catalog_manager.cc:4584] TS 178f33c315554588ad48b5b3dbb4b228 (127.15.37.1:46057): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 344d6a11242844bdad74d9c1a123ab7e: Network error: Client connection negotiation failed: client connection to 127.15.37.1:46057: connect: Connection refused (error 111)
I20260810 21:07:35.083997 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 8562
I20260810 21:07:35.106864 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 7920
I20260810 21:07:55.124840 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39625
--webserver_interface=127.15.37.62
--webserver_port=43719
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:39625
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:07:55.212333 8856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:55.212580 8856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:55.212605 8856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:55.213819 8856 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 21:07:55.213871 8856 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 21:07:55.213884 8856 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 21:07:55.213896 8856 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:07:55.213910 8856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:55.213923 8856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:55.213935 8856 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:07:55.214002 8856 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:07:55.215559 8856 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:39625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=43719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:55.215847 8856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:55.216118 8856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 21:07:55.226749 8856 server_base.cc:1034] running on GCE node
W20260810 21:07:55.226719 8866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:55.226905 8872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:55.226739 8869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:55.227221 8856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:55.227596 8856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:55.228750 8856 hybrid_clock.cc:648] HybridClock initialized: now 1786396075228727 us; error 49 us; skew 500 ppm
Aug 10 21:07:55 dist-test-slave-jq4t krb5kdc[7901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396075, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:55.235049 8856 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:07:55.235522 8856 webserver.cc:460] Webserver started at http://127.15.37.62:43719/ using document root <none> and password file <none>
I20260810 21:07:55.235751 8856 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:55.235811 8856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:55.237377 8856 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:55.238263 8881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:55.238466 8856 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:55.238579 8856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "09d44c6a9719457d81a8eeccc77298c3"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "156879796c27e04d97ed2042265c381a"
server_key_iv: "fdb5ddfe29ad3e7c98a3a4029e90fe4e"
server_key_version: "encryptionkey@0"
I20260810 21:07:55.239176 8856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:55.260011 8856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:55.262240 8856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:55.262406 8856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:55.266925 8856 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:39625
I20260810 21:07:55.266984 8978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:39625 every 8 connection(s)
I20260810 21:07:55.267446 8856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:07:55.269209 8980 sys_catalog.cc:263] Verifying existing consensus state
I20260810 21:07:55.269868 8980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Bootstrap starting.
I20260810 21:07:55.271776 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 8856
I20260810 21:07:55.272117 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:46057
--local_ip_for_outbound_sockets=127.15.37.1
--tserver_master_addrs=127.15.37.62:39625
--webserver_port=45315
--webserver_interface=127.15.37.1
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:07:55.280015 8980 log.cc:824] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:55.282224 8980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 21:07:55.282584 8980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Bootstrap complete.
I20260810 21:07:55.285120 8980 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } }
I20260810 21:07:55.285353 8980 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09d44c6a9719457d81a8eeccc77298c3, State: Initialized, Role: FOLLOWER
I20260810 21:07:55.285538 8980 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } }
I20260810 21:07:55.285602 8980 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:07:55.285658 8980 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:07:55.285710 8980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 21:07:55.286831 8980 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } }
I20260810 21:07:55.286931 8980 leader_election.cc:302] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09d44c6a9719457d81a8eeccc77298c3; no voters:
I20260810 21:07:55.287140 8980 leader_election.cc:288] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 21:07:55.287181 8987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 21:07:55.287405 8987 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 2 LEADER]: Becoming Leader. State: Replica: 09d44c6a9719457d81a8eeccc77298c3, State: Running, Role: LEADER
I20260810 21:07:55.287444 8980 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:07:55.287587 8987 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } }
I20260810 21:07:55.287964 8988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "09d44c6a9719457d81a8eeccc77298c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } } }
I20260810 21:07:55.288059 8988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:55.288506 8989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09d44c6a9719457d81a8eeccc77298c3. Latest consensus state: current_term: 2 leader_uuid: "09d44c6a9719457d81a8eeccc77298c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } } }
I20260810 21:07:55.288612 8989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: This master's current role is: LEADER
I20260810 21:07:55.288810 8998 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:07:55.289747 8998 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:07:55.289901 8998 catalog_manager.cc:1259] Loaded cluster ID: 9280188fb3124b1297f097346a943f0c
I20260810 21:07:55.289973 8998 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:07:55.291200 8998 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:07:55.291481 8998 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Loaded TSK: 0
I20260810 21:07:55.312559 8998 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Generated new TSK 1
I20260810 21:07:55.312702 8998 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 21:07:55.364111 8984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:55.364358 8984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:55.364396 8984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:55.365725 8984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:55.365783 8984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:55.365813 8984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:07:55.367481 8984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:46057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=45315
--tserver_master_addrs=127.15.37.62:39625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:55.367772 8984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:55.368057 8984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:55.374296 9029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:55.374451 8984 server_base.cc:1034] running on GCE node
W20260810 21:07:55.374293 9024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:55.374296 9032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:55.374773 8984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:55.375102 8984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:55.376299 8984 hybrid_clock.cc:648] HybridClock initialized: now 1786396075376269 us; error 49 us; skew 500 ppm
Aug 10 21:07:55 dist-test-slave-jq4t krb5kdc[7901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396075, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:55.379223 8984 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:07:55.379907 8984 webserver.cc:460] Webserver started at http://127.15.37.1:45315/ using document root <none> and password file <none>
I20260810 21:07:55.380236 8984 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:55.380322 8984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:55.382630 8984 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:07:55.383586 9046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:55.384286 8984 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:55.384446 8984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "178f33c315554588ad48b5b3dbb4b228"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "d3da30552f09d6a369082821a2116b89"
server_key_iv: "a0a1a7abf2e4d7a577391d7ae2119cf8"
server_key_version: "encryptionkey@0"
I20260810 21:07:55.385026 8984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:55.396373 8984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:55.399016 8984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:55.399197 8984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:55.399494 8984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:55.400049 9061 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 21:07:55.401721 8984 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 21:07:55.401777 8984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 21:07:55.401814 8984 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 21:07:55.402542 8984 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 21:07:55.402588 8984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 21:07:55.402648 9061 tablet_bootstrap.cc:492] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Bootstrap starting.
I20260810 21:07:55.411131 8984 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:46057
I20260810 21:07:55.411681 8984 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:07:55.415447 9061 log.cc:824] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:55.415956 9236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:46057 every 8 connection(s)
I20260810 21:07:55.418187 9061 tablet_bootstrap.cc:492] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 21:07:55.418507 9061 tablet_bootstrap.cc:492] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Bootstrap complete.
I20260810 21:07:55.419205 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 8984
I20260810 21:07:55.419530 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:37645
--local_ip_for_outbound_sockets=127.15.37.2
--tserver_master_addrs=127.15.37.62:39625
--webserver_port=38417
--webserver_interface=127.15.37.2
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:07:55.419840 9061 ts_tablet_manager.cc:1397] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.004s
I20260810 21:07:55.421841 9061 raft_consensus.cc:348] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:55.422343 9061 raft_consensus.cc:729] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f33c315554588ad48b5b3dbb4b228, State: Initialized, Role: FOLLOWER
I20260810 21:07:55.422570 9061 consensus_queue.cc:260] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:55.422979 9061 ts_tablet_manager.cc:1428] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Time spent starting tablet: real 0.003s user 0.003s sys 0.003s
Aug 10 21:07:55 dist-test-slave-jq4t krb5kdc[7901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396075, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:55.429522 9240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.412622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:42621 (local address 127.15.37.62:39625)
0810 21:07:55.416303 (+ 3681us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:55.416314 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:55.416361 (+ 47us) server_negotiation.cc:407] Connection header received
0810 21:07:55.416841 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:55.416849 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:55.416908 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:55.417061 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:55.417956 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.419411 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.421051 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.421640 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.421739 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.424753 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:55.424758 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:55.424759 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:55.424772 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:55.427077 (+ 2305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:55.427696 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:55.427700 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:55.427700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:55.427828 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:55.428182 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:55.428183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:55.428184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:55.428614 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:55.428726 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:55.429160 (+ 434us) server_negotiation.cc:299] Negotiation successful
0810 21:07:55.429309 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3620,"thread_start_us":87,"threads_started":1}
I20260810 21:07:55.429579 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.412529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:42621)
0810 21:07:55.415785 (+ 3256us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:55.415836 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:55.416599 (+ 763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:55.417114 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:55.417118 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:55.417511 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:55.417803 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.417810 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.419560 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.419562 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.420942 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.420946 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.421838 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.421839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.421966 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.422626 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:55.422637 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:55.424593 (+ 1956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:55.427187 (+ 2594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:55.427197 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:55.427200 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:55.427577 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:55.427912 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:55.427913 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:55.427913 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:55.428081 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:55.428712 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:55.428721 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:55.428931 (+ 210us) client_negotiation.cc:769] Sending connection context
0810 21:07:55.429074 (+ 143us) client_negotiation.cc:240] Negotiation successful
0810 21:07:55.429303 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3202,"thread_start_us":109,"threads_started":1}
I20260810 21:07:55.431063 9237 heartbeater.cc:347] Connected to a master server at 127.15.37.62:39625
I20260810 21:07:55.431173 9237 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:55.431383 9237 heartbeater.cc:511] Master 127.15.37.62:39625 requested a full tablet report, sending...
I20260810 21:07:55.432420 8914 ts_manager.cc:194] Registered new tserver with Master: 178f33c315554588ad48b5b3dbb4b228 (127.15.37.1:46057)
I20260810 21:07:55.433699 8914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:42621
I20260810 21:07:55.434823 9237 heartbeater.cc:503] Master 127.15.37.62:39625 was elected leader, sending a full tablet report...
I20260810 21:07:55.441372 9245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.433549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42194 (local address 127.15.37.1:46057)
0810 21:07:55.436887 (+ 3338us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:55.436892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:55.436902 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:07:55.436938 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:55.436940 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:55.436955 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:55.437028 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:55.437242 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.438334 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.440107 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.440893 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.440981 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.441044 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:55.441247 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 21:07:55.441294 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3301,"thread_start_us":85,"threads_started":1}
I20260810 21:07:55.441417 9244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.433245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:46057 (local address 127.0.0.1:42194)
0810 21:07:55.436612 (+ 3367us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:55.436662 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:55.436742 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:55.437057 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:55.437062 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:55.437065 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:55.437157 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.437159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.438440 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.438442 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.439963 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.439970 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.440996 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.440997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.441102 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.441120 (+ 18us) client_negotiation.cc:769] Sending connection context
0810 21:07:55.441212 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 21:07:55.441279 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3329,"thread_start_us":113,"threads_started":1}
I20260810 21:07:55.442080 9111 tablet_service.cc:1514] Processing DeleteTablet for tablet 344d6a11242844bdad74d9c1a123ab7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:35 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:42194
I20260810 21:07:55.442844 9246 tablet_replica.cc:330] stopping tablet replica
I20260810 21:07:55.442977 9246 raft_consensus.cc:2229] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:07:55.443074 9246 raft_consensus.cc:2258] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:07:55.443465 9246 ts_tablet_manager.cc:1905] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:07:55.446085 9246 ts_tablet_manager.cc:1918] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:07:55.446179 9246 log.cc:1196] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal/wals/344d6a11242844bdad74d9c1a123ab7e
I20260810 21:07:55.446414 9246 ts_tablet_manager.cc:1939] T 344d6a11242844bdad74d9c1a123ab7e P 178f33c315554588ad48b5b3dbb4b228: Deleting consensus metadata
I20260810 21:07:55.447036 8888 catalog_manager.cc:4841] TS 178f33c315554588ad48b5b3dbb4b228 (127.15.37.1:46057): tablet 344d6a11242844bdad74d9c1a123ab7e (table test-table [id=08bb5d9db7534d73a04142f753f1a48b]) successfully deleted
W20260810 21:07:55.514870 9242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:55.515108 9242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:55.515134 9242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:55.516263 9242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:55.516300 9242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:55.516326 9242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:07:55.517926 9242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:37645
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=38417
--tserver_master_addrs=127.15.37.62:39625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:55.518142 9242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:55.518342 9242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:55.523790 9256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:55.523819 9260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:55.523790 9255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:55.524108 9242 server_base.cc:1034] running on GCE node
I20260810 21:07:55.524402 9242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:55.524718 9242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:55.525976 9242 hybrid_clock.cc:648] HybridClock initialized: now 1786396075525953 us; error 40 us; skew 500 ppm
Aug 10 21:07:55 dist-test-slave-jq4t krb5kdc[7901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396075, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:55.528832 9242 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:07:55.529353 9242 webserver.cc:460] Webserver started at http://127.15.37.2:38417/ using document root <none> and password file <none>
I20260810 21:07:55.529608 9242 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:55.529702 9242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:55.531279 9242 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:55.532059 9274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:55.532333 9242 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:55.532462 9242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "d7b8260706254935bc95b955915d16b2"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "962ac0476be6e6212b8410cbef5b0235"
server_key_iv: "04a0d7d5fd0a88a869d1b2301f67015a"
server_key_version: "encryptionkey@0"
I20260810 21:07:55.532964 9242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:55.574892 9242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:55.577196 9242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:55.577387 9242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:55.577665 9242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:55.578014 9242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:55.578073 9242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:55.578122 9242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:55.578153 9242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:55.584347 9242 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:37645
I20260810 21:07:55.584437 9462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:37645 every 8 connection(s)
I20260810 21:07:55.584869 9242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:07:55.588311 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 9242
I20260810 21:07:55.588685 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:41977
--local_ip_for_outbound_sockets=127.15.37.3
--tserver_master_addrs=127.15.37.62:39625
--webserver_port=45967
--webserver_interface=127.15.37.3
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 21:07:55 dist-test-slave-jq4t krb5kdc[7901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396075, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:55.596820 9240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.585725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:47979 (local address 127.15.37.62:39625)
0810 21:07:55.585801 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:55.585805 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:55.586060 (+ 255us) server_negotiation.cc:407] Connection header received
0810 21:07:55.586573 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:55.586574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:55.586585 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:55.586640 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:55.587670 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.588355 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.590034 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.590387 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.590438 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.593452 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:55.593454 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:55.593455 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:55.593464 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:55.595216 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:55.595657 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:55.595658 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:55.595658 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:55.595731 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:55.595986 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:55.595987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:55.595988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:55.596161 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:55.596239 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:55.596554 (+ 315us) server_negotiation.cc:299] Negotiation successful
0810 21:07:55.596671 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 21:07:55.597066 9467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.585726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:47979)
0810 21:07:55.585925 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:55.585967 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:55.586484 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:55.586723 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:55.586726 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:55.587354 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:55.587576 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.587580 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.588518 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.588519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.589919 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.589924 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.590548 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.590549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.590723 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.591362 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:55.591374 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:55.593343 (+ 1969us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:55.595317 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:55.595325 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:55.595327 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:55.595575 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:55.595806 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:55.595806 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:55.595807 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:55.595913 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:55.596238 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:55.596245 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:55.596379 (+ 134us) client_negotiation.cc:769] Sending connection context
0810 21:07:55.596541 (+ 162us) client_negotiation.cc:240] Negotiation successful
0810 21:07:55.596740 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":97,"threads_started":1}
I20260810 21:07:55.597613 9463 heartbeater.cc:347] Connected to a master server at 127.15.37.62:39625
I20260810 21:07:55.597708 9463 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:55.597921 9463 heartbeater.cc:511] Master 127.15.37.62:39625 requested a full tablet report, sending...
I20260810 21:07:55.598402 8914 ts_manager.cc:194] Registered new tserver with Master: d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645)
I20260810 21:07:55.598984 8914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:47979
W20260810 21:07:55.681115 9470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:07:55.681347 9470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:07:55.681375 9470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:07:55.682588 9470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:07:55.682628 9470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:07:55.682655 9470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:07:55.684182 9470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:41977
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=45967
--tserver_master_addrs=127.15.37.62:39625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:07:55.684401 9470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:07:55.684690 9470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:07:55.690801 9481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:55.690807 9476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:07:55.690809 9478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:07:55.691071 9470 server_base.cc:1034] running on GCE node
I20260810 21:07:55.691296 9470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:07:55.691529 9470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:07:55.692667 9470 hybrid_clock.cc:648] HybridClock initialized: now 1786396075692653 us; error 30 us; skew 500 ppm
Aug 10 21:07:55 dist-test-slave-jq4t krb5kdc[7901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396075, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:07:55.695237 9470 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:07:55.695763 9470 webserver.cc:460] Webserver started at http://127.15.37.3:45967/ using document root <none> and password file <none>
I20260810 21:07:55.696040 9470 fs_manager.cc:359] Metadata directory not provided
I20260810 21:07:55.696101 9470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:07:55.697597 9470 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:55.698292 9493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:55.698498 9470 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:07:55.698609 9470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "f0aee42985f14a5fb13079e2582cd08b"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "d08c837d4dc5491f4c089f54277542a4"
server_key_iv: "afa4b96f1433ab7c1ad92793a29a995e"
server_key_version: "encryptionkey@0"
I20260810 21:07:55.698976 9470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:07:55.713936 9470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:07:55.716578 9470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:07:55.716773 9470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:07:55.717051 9470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:07:55.717401 9470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:07:55.717459 9470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:55.717504 9470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:07:55.717562 9470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:55.723932 9470 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:41977
I20260810 21:07:55.723984 9693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:41977 every 8 connection(s)
I20260810 21:07:55.724362 9470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:07:55.726508 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 9470
Aug 10 21:07:55 dist-test-slave-jq4t krb5kdc[7901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396075, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:07:55.735143 9703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.727015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53130 (local address 127.15.37.62:39625)
0810 21:07:55.727131 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:55.727132 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:55.727245 (+ 113us) server_negotiation.cc:407] Connection header received
0810 21:07:55.727316 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:55.727317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:55.727326 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:55.727385 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:55.728114 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.728733 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.729898 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.730256 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.730337 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.732036 (+ 1699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:55.732038 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:55.732038 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:55.732047 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:55.733921 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:55.734355 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:55.734356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:55.734356 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:55.734411 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:55.734626 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:55.734627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:55.734627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:55.734738 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:55.734871 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:55.734997 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 21:07:55.735066 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":10,"server-negotiator.queue_time_us":91,"thread_start_us":54,"threads_started":1}
I20260810 21:07:55.736591 9240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.725245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:43761 (local address 127.15.37.62:39625)
0810 21:07:55.725327 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:55.725330 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:55.725571 (+ 241us) server_negotiation.cc:407] Connection header received
0810 21:07:55.726217 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:55.726218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:55.726230 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:55.726322 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:55.727729 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.728345 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.729919 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.730256 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.730337 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.733241 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:55.733243 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:55.733243 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:55.733251 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:55.734819 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:55.735344 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:55.735345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:55.735345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:55.735412 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:55.735763 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:55.735764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:55.735765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:55.735900 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:55.736002 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:55.736372 (+ 370us) server_negotiation.cc:299] Negotiation successful
0810 21:07:55.736446 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":11,"server-negotiator.queue_time_us":42}
I20260810 21:07:55.736840 9700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.725226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:43761)
0810 21:07:55.725436 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:55.725478 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:55.726117 (+ 639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:55.726380 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:55.726384 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:55.727296 (+ 912us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:07:55.727627 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.727635 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.728453 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.728453 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.729826 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.729829 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.730378 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.730401 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.730587 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.731173 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:07:55.731186 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:07:55.733132 (+ 1946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:07:55.734916 (+ 1784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:55.734926 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:55.734929 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:55.735259 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:55.735558 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:07:55.735558 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:07:55.735559 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:07:55.735671 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:07:55.736017 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:07:55.736027 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:07:55.736233 (+ 206us) client_negotiation.cc:769] Sending connection context
0810 21:07:55.736339 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 21:07:55.736550 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":106,"threads_started":1}
I20260810 21:07:55.737308 9695 heartbeater.cc:347] Connected to a master server at 127.15.37.62:39625
I20260810 21:07:55.737401 9695 heartbeater.cc:464] Registering TS with master...
I20260810 21:07:55.737568 9695 heartbeater.cc:511] Master 127.15.37.62:39625 requested a full tablet report, sending...
I20260810 21:07:55.737933 8914 ts_manager.cc:194] Registered new tserver with Master: f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977)
I20260810 21:07:55.738332 8914 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:43761
I20260810 21:07:55.747187 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:07:55.750201 9240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.747650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53132 (local address 127.15.37.62:39625)
0810 21:07:55.747721 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:55.747722 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:55.747881 (+ 159us) server_negotiation.cc:407] Connection header received
0810 21:07:55.747953 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:55.747954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:55.748011 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:55.748080 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:07:55.748221 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.748805 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.749577 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.749760 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.749810 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.749951 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:07:55.750007 (+ 56us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0810 21:07:55.750142 (+ 135us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53132: token expired
Metrics: {"server-negotiator.queue_time_us":43}
W20260810 21:07:55.750260 9240 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53132: token expired
W20260810 21:07:55.750438 8789 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.37.62:39625)
I20260810 21:07:55.757032 9240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.750728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53146 (local address 127.15.37.62:39625)
0810 21:07:55.750791 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:55.750794 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:55.750804 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:07:55.750843 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:55.750844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:55.750854 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:55.750903 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:07:55.751443 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.751904 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.752678 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.752878 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.752954 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.754392 (+ 1438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:07:55.754394 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:07:55.754394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:07:55.754402 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:07:55.755648 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:55.756043 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:55.756044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:55.756045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:55.756114 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:07:55.756330 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:07:55.756331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:07:55.756331 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:07:55.756577 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:07:55.756694 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:55.756836 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 21:07:55.756921 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 21:07:55.758316 8914 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:07:55.760110 8914 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:07:55.762806 9111 tablet_service.cc:1467] Processing CreateTablet for tablet 25c56acd1baf49ab9da5079ac193af7b (DEFAULT_TABLE table=test-table [id=eee657113ea84d9393f213443911f600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:55.763051 9111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25c56acd1baf49ab9da5079ac193af7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:55.764837 9061 tablet_bootstrap.cc:492] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228: Bootstrap starting.
I20260810 21:07:55.765211 9061 tablet_bootstrap.cc:654] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:55.765996 9061 tablet_bootstrap.cc:492] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228: No bootstrap required, opened a new log
I20260810 21:07:55.766054 9061 ts_tablet_manager.cc:1397] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260810 21:07:55.766168 9061 raft_consensus.cc:348] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:55.766251 9061 raft_consensus.cc:374] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:55.766309 9061 raft_consensus.cc:729] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f33c315554588ad48b5b3dbb4b228, State: Initialized, Role: FOLLOWER
I20260810 21:07:55.766357 9061 consensus_queue.cc:260] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:55.766474 9061 ts_tablet_manager.cc:1428] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 21:07:55.766603 9244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.762232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:41977 (local address 127.0.0.1:52300)
0810 21:07:55.762312 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:55.762328 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:55.762380 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:55.762857 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:55.762858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:55.762860 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:55.762914 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.762916 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.764212 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.764213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.765249 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.765252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.766359 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.766360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.766433 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.766439 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 21:07:55.766469 (+ 30us) client_negotiation.cc:240] Negotiation successful
0810 21:07:55.766531 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":27}
I20260810 21:07:55.766826 9706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.762327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:37645 (local address 127.0.0.1:58080)
0810 21:07:55.762466 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:55.762485 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:55.762533 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:55.763135 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:55.763136 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:55.763139 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:55.763180 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.763182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.764416 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.764418 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.765481 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.765484 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.766581 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.766583 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.766645 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.766649 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:07:55.766703 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 21:07:55.766753 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":16,"thread_start_us":102,"threads_started":1}
I20260810 21:07:55.767009 9708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.762362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52300 (local address 127.15.37.3:41977)
0810 21:07:55.762691 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:55.762696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:55.762704 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:07:55.762745 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:55.762747 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:55.762761 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:55.762860 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:55.762965 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.764104 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.765351 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.766240 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.766738 (+ 498us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.766809 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:55.766839 (+ 30us) server_negotiation.cc:299] Negotiation successful
0810 21:07:55.766909 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":155,"threads_started":1}
I20260810 21:07:55.767081 9709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.762714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58080 (local address 127.15.37.2:37645)
0810 21:07:55.762934 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:55.762939 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:55.762950 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:07:55.763017 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:55.763019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:55.763035 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:55.763128 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:55.763283 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.764325 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.765585 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.766389 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.766464 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.766539 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:55.766938 (+ 399us) server_negotiation.cc:299] Negotiation successful
0810 21:07:55.766990 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":97,"threads_started":1}
I20260810 21:07:55.767802 9570 tablet_service.cc:1467] Processing CreateTablet for tablet 25c56acd1baf49ab9da5079ac193af7b (DEFAULT_TABLE table=test-table [id=eee657113ea84d9393f213443911f600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:55.767859 9358 tablet_service.cc:1467] Processing CreateTablet for tablet 25c56acd1baf49ab9da5079ac193af7b (DEFAULT_TABLE table=test-table [id=eee657113ea84d9393f213443911f600]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:07:55.768206 9570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25c56acd1baf49ab9da5079ac193af7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:55.768224 9358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25c56acd1baf49ab9da5079ac193af7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:07:55.771414 9712 tablet_bootstrap.cc:492] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2: Bootstrap starting.
I20260810 21:07:55.772200 9712 tablet_bootstrap.cc:654] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:55.772274 9711 tablet_bootstrap.cc:492] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b: Bootstrap starting.
I20260810 21:07:55.772922 9712 log.cc:824] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:55.773056 9711 tablet_bootstrap.cc:654] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b: Neither blocks nor log segments found. Creating new log.
I20260810 21:07:55.773655 9711 log.cc:824] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b: Log is configured to *not* fsync() on all Append() calls
I20260810 21:07:55.773823 9712 tablet_bootstrap.cc:492] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2: No bootstrap required, opened a new log
I20260810 21:07:55.773903 9712 ts_tablet_manager.cc:1397] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:07:55.774502 9711 tablet_bootstrap.cc:492] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b: No bootstrap required, opened a new log
I20260810 21:07:55.774580 9711 ts_tablet_manager.cc:1397] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 21:07:55.776070 9712 raft_consensus.cc:348] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:55.776281 9712 raft_consensus.cc:374] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:55.776320 9712 raft_consensus.cc:729] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7b8260706254935bc95b955915d16b2, State: Initialized, Role: FOLLOWER
I20260810 21:07:55.776464 9712 consensus_queue.cc:260] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:55.776847 9712 ts_tablet_manager.cc:1428] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260810 21:07:55.776871 9463 heartbeater.cc:503] Master 127.15.37.62:39625 was elected leader, sending a full tablet report...
I20260810 21:07:55.776750 9711 raft_consensus.cc:348] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:55.776940 9711 raft_consensus.cc:374] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:07:55.776991 9711 raft_consensus.cc:729] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0aee42985f14a5fb13079e2582cd08b, State: Initialized, Role: FOLLOWER
I20260810 21:07:55.777107 9711 consensus_queue.cc:260] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:55.777402 9711 ts_tablet_manager.cc:1428] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:07:55.777453 9695 heartbeater.cc:503] Master 127.15.37.62:39625 was elected leader, sending a full tablet report...
I20260810 21:07:55.812597 9715 raft_consensus.cc:482] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:07:55.812816 9715 raft_consensus.cc:504] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:55.813304 9715 leader_election.cc:288] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977), 178f33c315554588ad48b5b3dbb4b228 (127.15.37.1:46057)
I20260810 21:07:55.817517 9708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.813644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:39703 (local address 127.15.37.3:41977)
0810 21:07:55.813721 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:55.813723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:55.813734 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:07:55.813767 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:55.813768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:55.813786 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:55.813904 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:55.814081 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.814852 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.816502 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.817122 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.817192 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.817204 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:55.817389 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 21:07:55.817439 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260810 21:07:55.817517 9245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.813780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:54111 (local address 127.15.37.1:46057)
0810 21:07:55.813855 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:55.813857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:55.813904 (+ 47us) server_negotiation.cc:407] Connection header received
0810 21:07:55.813966 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:55.813967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:55.813982 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:55.814029 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:07:55.814176 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.814879 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.816508 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.817103 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.817192 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.817204 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:55.817397 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 21:07:55.817440 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 21:07:55.817543 9467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.813531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:41977 (local address 127.15.37.2:39703)
0810 21:07:55.813598 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:55.813611 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:55.813657 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:55.813909 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:55.813910 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:55.813912 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:55.813999 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.814001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.814967 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.814968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.816352 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.816356 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.817211 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.817212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.817302 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.817304 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 21:07:55.817365 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 21:07:55.817421 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":66}
I20260810 21:07:55.817550 9718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.813663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:46057 (local address 127.15.37.2:54111)
0810 21:07:55.813844 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:55.813854 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:07:55.813906 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:07:55.814049 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:07:55.814050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:07:55.814052 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:07:55.814110 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.814111 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.814967 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.814968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.816352 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:07:55.816356 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.817211 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.817212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:07:55.817298 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.817302 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:07:55.817365 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 21:07:55.817421 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":67,"thread_start_us":109,"threads_started":1}
I20260810 21:07:55.817979 9601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25c56acd1baf49ab9da5079ac193af7b" candidate_uuid: "d7b8260706254935bc95b955915d16b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0aee42985f14a5fb13079e2582cd08b" is_pre_election: true
I20260810 21:07:55.817993 9163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25c56acd1baf49ab9da5079ac193af7b" candidate_uuid: "d7b8260706254935bc95b955915d16b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f33c315554588ad48b5b3dbb4b228" is_pre_election: true
I20260810 21:07:55.818181 9163 raft_consensus.cc:2454] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7b8260706254935bc95b955915d16b2 in term 0.
I20260810 21:07:55.818181 9601 raft_consensus.cc:2454] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7b8260706254935bc95b955915d16b2 in term 0.
I20260810 21:07:55.818447 9278 leader_election.cc:302] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 178f33c315554588ad48b5b3dbb4b228, d7b8260706254935bc95b955915d16b2; no voters:
I20260810 21:07:55.818624 9715 raft_consensus.cc:2781] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:07:55.818720 9715 raft_consensus.cc:482] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:07:55.818758 9715 raft_consensus.cc:3037] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:55.819562 9715 raft_consensus.cc:504] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:55.819725 9715 leader_election.cc:288] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977), 178f33c315554588ad48b5b3dbb4b228 (127.15.37.1:46057)
I20260810 21:07:55.820003 9163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25c56acd1baf49ab9da5079ac193af7b" candidate_uuid: "d7b8260706254935bc95b955915d16b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "178f33c315554588ad48b5b3dbb4b228"
I20260810 21:07:55.820003 9601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25c56acd1baf49ab9da5079ac193af7b" candidate_uuid: "d7b8260706254935bc95b955915d16b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0aee42985f14a5fb13079e2582cd08b"
I20260810 21:07:55.820111 9601 raft_consensus.cc:3037] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:55.820109 9163 raft_consensus.cc:3037] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:07:55.821189 9601 raft_consensus.cc:2454] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7b8260706254935bc95b955915d16b2 in term 1.
I20260810 21:07:55.821399 9278 leader_election.cc:302] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7b8260706254935bc95b955915d16b2, f0aee42985f14a5fb13079e2582cd08b; no voters:
I20260810 21:07:55.821532 9715 raft_consensus.cc:2781] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:07:55.821570 9163 raft_consensus.cc:2454] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7b8260706254935bc95b955915d16b2 in term 1.
I20260810 21:07:55.821732 9715 raft_consensus.cc:686] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [term 1 LEADER]: Becoming Leader. State: Replica: d7b8260706254935bc95b955915d16b2, State: Running, Role: LEADER
I20260810 21:07:55.821846 9715 consensus_queue.cc:237] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:07:55.822916 8910 catalog_manager.cc:5495] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7b8260706254935bc95b955915d16b2 (127.15.37.2). New cstate: current_term: 1 leader_uuid: "d7b8260706254935bc95b955915d16b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } health_report { overall_health: UNKNOWN } } }
I20260810 21:07:55.829864 9709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.827310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58084 (local address 127.15.37.2:37645)
0810 21:07:55.827394 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 21:07:55.827396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:07:55.827405 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:07:55.827447 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:07:55.827448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:07:55.827465 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:07:55.827545 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:07:55.827691 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.828184 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.829020 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:07:55.829222 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:07:55.829300 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:07:55.829482 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:07:55.829595 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:07:55.829686 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 21:07:55.829726 (+ 40us) server_negotiation.cc:299] Negotiation successful
0810 21:07:55.829747 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 21:07:55.832039 9163 raft_consensus.cc:1261] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Refusing update from remote peer d7b8260706254935bc95b955915d16b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:07:55.832039 9601 raft_consensus.cc:1261] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b [term 1 FOLLOWER]: Refusing update from remote peer d7b8260706254935bc95b955915d16b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:07:55.832533 9715 consensus_queue.cc:1035] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:07:55.832705 9719 consensus_queue.cc:1035] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:07:55.838016 8914 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:07:55.838122 8914 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:07:55.838958 8914 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Sending DeleteTablet for 3 replicas of tablet 25c56acd1baf49ab9da5079ac193af7b
I20260810 21:07:55.839344 9111 tablet_service.cc:1514] Processing DeleteTablet for tablet 25c56acd1baf49ab9da5079ac193af7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:55 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:42194
I20260810 21:07:55.839329 9570 tablet_service.cc:1514] Processing DeleteTablet for tablet 25c56acd1baf49ab9da5079ac193af7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:55 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:52300
I20260810 21:07:55.839345 9358 tablet_service.cc:1514] Processing DeleteTablet for tablet 25c56acd1baf49ab9da5079ac193af7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:07:55 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:58080
I20260810 21:07:55.839449 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 8984
I20260810 21:07:55.845726 9736 tablet_replica.cc:330] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2: stopping tablet replica
I20260810 21:07:55.845901 9736 raft_consensus.cc:2229] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:07:55.846035 9736 raft_consensus.cc:2258] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:07:55.847661 9736 ts_tablet_manager.cc:1905] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:07:55.849612 9736 ts_tablet_manager.cc:1918] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:07:55.849687 9736 log.cc:1196] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/25c56acd1baf49ab9da5079ac193af7b
I20260810 21:07:55.849946 9736 ts_tablet_manager.cc:1939] T 25c56acd1baf49ab9da5079ac193af7b P d7b8260706254935bc95b955915d16b2: Deleting consensus metadata
I20260810 21:07:55.850538 9734 tablet_replica.cc:330] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b: stopping tablet replica
I20260810 21:07:55.850689 9734 raft_consensus.cc:2229] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:07:55.850848 9734 raft_consensus.cc:2258] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:07:55.851385 9734 ts_tablet_manager.cc:1905] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:07:55.853120 9734 ts_tablet_manager.cc:1918] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:07:55.853212 9734 log.cc:1196] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/25c56acd1baf49ab9da5079ac193af7b
I20260810 21:07:55.853528 9734 ts_tablet_manager.cc:1939] T 25c56acd1baf49ab9da5079ac193af7b P f0aee42985f14a5fb13079e2582cd08b: Deleting consensus metadata
I20260810 21:07:55.854815 8888 catalog_manager.cc:4841] TS f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977): tablet 25c56acd1baf49ab9da5079ac193af7b (table test-table [id=eee657113ea84d9393f213443911f600]) successfully deleted
I20260810 21:07:55.854936 8888 catalog_manager.cc:4841] TS d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645): tablet 25c56acd1baf49ab9da5079ac193af7b (table test-table [id=eee657113ea84d9393f213443911f600]) successfully deleted
W20260810 21:07:55.859764 8888 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:46057 (error 108)
I20260810 21:07:55.860080 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 9242
I20260810 21:07:55.865746 9706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:07:55.865521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:46057 (local address 127.0.0.1:42206)
0810 21:07:55.865612 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0810 21:07:55.865687 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:46057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260810 21:07:55.865959 8888 catalog_manager.cc:4584] TS 178f33c315554588ad48b5b3dbb4b228 (127.15.37.1:46057): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 25c56acd1baf49ab9da5079ac193af7b: Network error: Client connection negotiation failed: client connection to 127.15.37.1:46057: connect: Connection refused (error 111)
I20260810 21:07:55.879009 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 9470
I20260810 21:07:55.889272 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 8856
I20260810 21:08:15.907922 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39625
--webserver_interface=127.15.37.62
--webserver_port=43719
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:39625
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:15.997617 9743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:15.997911 9743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:15.997953 9743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:15.999205 9743 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 21:08:15.999276 9743 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 21:08:15.999298 9743 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 21:08:15.999320 9743 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:15.999347 9743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:15.999377 9743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:15.999418 9743 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:15.999449 9743 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:16.001168 9743 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:39625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=43719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:16.001499 9743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:16.001775 9743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:16.007679 9751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:16.007710 9743 server_base.cc:1034] running on GCE node
W20260810 21:08:16.007737 9750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:16.007679 9753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:16.008296 9743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:16.008688 9743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:16.009852 9743 hybrid_clock.cc:648] HybridClock initialized: now 1786396096009841 us; error 34 us; skew 500 ppm
Aug 10 21:08:16 dist-test-slave-jq4t krb5kdc[7901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396096, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:16.016181 9743 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:08:16.016767 9743 webserver.cc:460] Webserver started at http://127.15.37.62:43719/ using document root <none> and password file <none>
I20260810 21:08:16.017023 9743 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:16.017073 9743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:16.018631 9743 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:08:16.019472 9772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:16.019685 9743 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:16.019798 9743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "09d44c6a9719457d81a8eeccc77298c3"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "156879796c27e04d97ed2042265c381a"
server_key_iv: "fdb5ddfe29ad3e7c98a3a4029e90fe4e"
server_key_version: "encryptionkey@0"
I20260810 21:08:16.020201 9743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:16.032106 9743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:16.034237 9743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:16.034468 9743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:16.038966 9743 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:39625
I20260810 21:08:16.039006 9845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:39625 every 8 connection(s)
I20260810 21:08:16.039448 9743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:16.041200 9846 sys_catalog.cc:263] Verifying existing consensus state
I20260810 21:08:16.041965 9846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Bootstrap starting.
I20260810 21:08:16.044695 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 9743
I20260810 21:08:16.045028 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:46057
--local_ip_for_outbound_sockets=127.15.37.1
--tserver_master_addrs=127.15.37.62:39625
--webserver_port=45315
--webserver_interface=127.15.37.1
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:08:16.052160 9846 log.cc:824] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:16.054630 9846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 21:08:16.055014 9846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: Bootstrap complete.
I20260810 21:08:16.057564 9846 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } }
I20260810 21:08:16.057811 9846 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09d44c6a9719457d81a8eeccc77298c3, State: Initialized, Role: FOLLOWER
I20260810 21:08:16.057997 9846 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } }
I20260810 21:08:16.058072 9846 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:16.058132 9846 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:16.058182 9846 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 21:08:16.059346 9846 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } }
I20260810 21:08:16.059468 9846 leader_election.cc:302] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09d44c6a9719457d81a8eeccc77298c3; no voters:
I20260810 21:08:16.059695 9846 leader_election.cc:288] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 21:08:16.059751 9856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 21:08:16.059942 9856 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [term 3 LEADER]: Becoming Leader. State: Replica: 09d44c6a9719457d81a8eeccc77298c3, State: Running, Role: LEADER
I20260810 21:08:16.060073 9846 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:16.060119 9856 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } }
I20260810 21:08:16.060454 9858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "09d44c6a9719457d81a8eeccc77298c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } } }
I20260810 21:08:16.060647 9858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:16.060447 9856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09d44c6a9719457d81a8eeccc77298c3. Latest consensus state: current_term: 3 leader_uuid: "09d44c6a9719457d81a8eeccc77298c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09d44c6a9719457d81a8eeccc77298c3" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39625 } } }
I20260810 21:08:16.060741 9856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:16.062134 9880 catalog_manager.cc:1259] Loaded cluster ID: 9280188fb3124b1297f097346a943f0c
I20260810 21:08:16.062206 9880 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: loading cluster ID for follower catalog manager: success
I20260810 21:08:16.063102 9880 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 09d44c6a9719457d81a8eeccc77298c3: acquiring CA information for follower catalog manager: success
F20260810 21:08:16.063468 9880 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2e3d93d9ad google::LogMessage::Fail() at ??:0
@ 0x7f2e3d94088a google::LogMessage::SendToLog() at ??:0
@ 0x7f2e3d93d4de google::LogMessage::Flush() at ??:0
@ 0x7f2e3d93ea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2e400aa104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f2e4589b6b9 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7f2e4589b989 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7f2e4589be4e kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7f2e4589e8c2 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7f2e3f800954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2e406646db start_thread at ??:0
@ 0x7f2e3c43b61f clone at ??:0
W20260810 21:08:16.150735 9848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:16.151032 9848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:16.151079 9848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:16.152319 9848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:16.152393 9848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:16.152441 9848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:08:16.154052 9848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:46057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=45315
--tserver_master_addrs=127.15.37.62:39625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:16.154352 9848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:16.154603 9848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:16.160189 9906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:16.160301 9848 server_base.cc:1034] running on GCE node
W20260810 21:08:16.160392 9913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:16.160182 9907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:16.160709 9848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:16.160979 9848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:16.162151 9848 hybrid_clock.cc:648] HybridClock initialized: now 1786396096162121 us; error 47 us; skew 500 ppm
Aug 10 21:08:16 dist-test-slave-jq4t krb5kdc[7901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396096, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:16.164902 9848 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:08:16.165419 9848 webserver.cc:460] Webserver started at http://127.15.37.1:45315/ using document root <none> and password file <none>
I20260810 21:08:16.165665 9848 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:16.165735 9848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:16.167232 9848 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:16.168046 9926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:16.168248 9848 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:16.168354 9848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "178f33c315554588ad48b5b3dbb4b228"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "d3da30552f09d6a369082821a2116b89"
server_key_iv: "a0a1a7abf2e4d7a577391d7ae2119cf8"
server_key_version: "encryptionkey@0"
I20260810 21:08:16.168833 9848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:16.180347 9848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:16.183221 9848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:16.183410 9848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:16.183693 9848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:16.184224 9935 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 21:08:16.186475 9848 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 21:08:16.186546 9848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 21:08:16.186594 9848 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 21:08:16.187309 9848 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 21:08:16.187363 9848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 21:08:16.187456 9935 tablet_bootstrap.cc:492] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228: Bootstrap starting.
I20260810 21:08:16.195194 9848 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:46057
I20260810 21:08:16.195314 10106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:46057 every 8 connection(s)
I20260810 21:08:16.195690 9848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:08:16.200850 9935 log.cc:824] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:16.201974 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 9848
I20260810 21:08:16.202287 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:37645
--local_ip_for_outbound_sockets=127.15.37.2
--tserver_master_addrs=127.15.37.62:39625
--webserver_port=38417
--webserver_interface=127.15.37.2
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:08:16.204697 9935 tablet_bootstrap.cc:492] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 21:08:16.205358 9935 tablet_bootstrap.cc:492] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228: Bootstrap complete.
I20260810 21:08:16.207074 9935 ts_tablet_manager.cc:1397] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.003s
I20260810 21:08:16.209306 9935 raft_consensus.cc:348] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:08:16.209906 9935 raft_consensus.cc:729] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 178f33c315554588ad48b5b3dbb4b228, State: Initialized, Role: FOLLOWER
I20260810 21:08:16.210135 9935 consensus_queue.cc:260] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:08:16.210503 9935 ts_tablet_manager.cc:1428] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
W20260810 21:08:16.280995 10112 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:08:16.196407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:54997)
0810 21:08:16.196656 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:16.196704 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:16.197206 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:16.280751 (+ 83545us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":157,"threads_started":1}
W20260810 21:08:16.281298 10107 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:39625 (0 consecutive failures): Network error: Failed to ping master at 127.15.37.62:39625: Client connection negotiation failed: client connection to 127.15.37.62:39625: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 21:08:16.281677 10112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:16.281540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:41813)
0810 21:08:16.281597 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:16.281648 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 21:08:16.282024 10112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:16.281925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:39769)
0810 21:08:16.281973 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:16.282002 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 21:08:16.282160 10107 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 21:08:16.297418 10114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:16.297662 10114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:16.297690 10114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:16.299048 10114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:16.299108 10114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:16.299140 10114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:08:16.300940 10114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:37645
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=38417
--tserver_master_addrs=127.15.37.62:39625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10114
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:16.301252 10114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:16.301533 10114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:16.307366 10127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:16.307350 10125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:16.307353 10124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:16.307678 10114 server_base.cc:1034] running on GCE node
I20260810 21:08:16.307917 10114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:16.308218 10114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:16.309417 10114 hybrid_clock.cc:648] HybridClock initialized: now 1786396096309347 us; error 88 us; skew 500 ppm
Aug 10 21:08:16 dist-test-slave-jq4t krb5kdc[7901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396096, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:16.312417 10114 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:08:16.312940 10114 webserver.cc:460] Webserver started at http://127.15.37.2:38417/ using document root <none> and password file <none>
I20260810 21:08:16.313158 10114 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:16.313202 10114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:16.314678 10114 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:16.315418 10141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:16.315637 10114 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:16.315740 10114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "d7b8260706254935bc95b955915d16b2"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "962ac0476be6e6212b8410cbef5b0235"
server_key_iv: "04a0d7d5fd0a88a869d1b2301f67015a"
server_key_version: "encryptionkey@0"
I20260810 21:08:16.316138 10114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:16.336709 10114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:16.339231 10114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:16.339373 10114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:16.339612 10114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:16.339915 10114 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:16.339958 10114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:16.339982 10114 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:16.339995 10114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:16.346769 10114 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:37645
I20260810 21:08:16.346838 10317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:37645 every 8 connection(s)
I20260810 21:08:16.347249 10114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:08:16.347640 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 10114
I20260810 21:08:16.347970 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:41977
--local_ip_for_outbound_sockets=127.15.37.3
--tserver_master_addrs=127.15.37.62:39625
--webserver_port=45967
--webserver_interface=127.15.37.3
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:08:16.348847 10320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:16.348121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:60907)
0810 21:08:16.348305 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:16.348389 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
W20260810 21:08:16.349086 10318 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:39625 (0 consecutive failures): Network error: Failed to ping master at 127.15.37.62:39625: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
I20260810 21:08:16.349403 10320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:16.349294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:54529)
0810 21:08:16.349348 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:16.349378 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 21:08:16.349696 10320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:16.349609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:51485)
0810 21:08:16.349650 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:16.349674 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260810 21:08:16.349844 10318 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 21:08:16.441098 10322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:16.441354 10322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:16.441383 10322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:16.442611 10322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:16.442657 10322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:16.442685 10322 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:08:16.444685 10322 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:41977
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=45967
--tserver_master_addrs=127.15.37.62:39625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:16.444933 10322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:16.445147 10322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:16.451036 10331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:16.451181 10337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:16.451310 10322 server_base.cc:1034] running on GCE node
W20260810 21:08:16.451043 10335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:16.451604 10322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:16.451905 10322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:16.453068 10322 hybrid_clock.cc:648] HybridClock initialized: now 1786396096453060 us; error 36 us; skew 500 ppm
Aug 10 21:08:16 dist-test-slave-jq4t krb5kdc[7901](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396096, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:16.455768 10322 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:08:16.456215 10322 webserver.cc:460] Webserver started at http://127.15.37.3:45967/ using document root <none> and password file <none>
I20260810 21:08:16.456425 10322 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:16.456521 10322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:16.457964 10322 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:08:16.458683 10345 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:16.458885 10322 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:08:16.458985 10322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "f0aee42985f14a5fb13079e2582cd08b"
format_stamp: "Formatted at 2026-08-10 21:07:34 on dist-test-slave-jq4t"
server_key: "d08c837d4dc5491f4c089f54277542a4"
server_key_iv: "afa4b96f1433ab7c1ad92793a29a995e"
server_key_version: "encryptionkey@0"
I20260810 21:08:16.459380 10322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:16.472201 10322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:16.474526 10322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:16.474691 10322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:16.474970 10322 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:16.475322 10322 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:16.475365 10322 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:16.475389 10322 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:16.475435 10322 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:16.482128 10322 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:41977
I20260810 21:08:16.482214 10527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:41977 every 8 connection(s)
I20260810 21:08:16.482633 10322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:08:16.483989 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:16.483476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:33771)
0810 21:08:16.483717 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:16.483803 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":108,"threads_started":1}
W20260810 21:08:16.484443 10528 heartbeater.cc:644] Failed to heartbeat to 127.15.37.62:39625 (0 consecutive failures): Network error: Failed to ping master at 127.15.37.62:39625: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
I20260810 21:08:16.484776 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 10322
I20260810 21:08:16.484839 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:16.484725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:51905)
0810 21:08:16.484780 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:16.484808 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 21:08:16.485167 10530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:16.485044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:47137)
0810 21:08:16.485094 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:16.485135 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 21:08:16.485364 10528 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 21:08:17.282982 10532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:17.282656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:34935)
0810 21:08:17.282827 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:17.282879 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":75,"threads_started":1}
I20260810 21:08:17.350615 10533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:17.350298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:50363)
0810 21:08:17.350488 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:17.350540 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":69,"threads_started":1}
I20260810 21:08:17.485997 10535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:17.485717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:34105)
0810 21:08:17.485873 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:17.485929 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":76,"threads_started":1}
I20260810 21:08:17.857194 10537 raft_consensus.cc:482] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:08:17.857339 10537 raft_consensus.cc:504] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:08:17.857666 10537 leader_election.cc:288] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977), d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645)
Aug 10 21:08:17 dist-test-slave-jq4t krb5kdc[7901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396096, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.3@KRBTEST.COM
Aug 10 21:08:17 dist-test-slave-jq4t krb5kdc[7901](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396096, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.2@KRBTEST.COM
I20260810 21:08:17.869969 10546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:17.858325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:38905 (local address 127.15.37.2:37645)
0810 21:08:17.858474 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:17.858484 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:17.858505 (+ 21us) server_negotiation.cc:407] Connection header received
0810 21:08:17.858931 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:17.858933 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:17.858975 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:17.859130 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:17.859900 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:17.861325 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:17.862455 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:17.862923 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:17.863088 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:17.866449 (+ 3361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:17.866453 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:17.866453 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:17.866463 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:17.868152 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:17.868643 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:17.868646 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:17.868647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:17.868738 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:17.869045 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:17.869046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:17.869047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:17.869303 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:17.869386 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:17.869701 (+ 315us) server_negotiation.cc:299] Negotiation successful
0810 21:08:17.869841 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":78,"threads_started":1}
I20260810 21:08:17.869988 10538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:17.857921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:41977 (local address 127.15.37.1:33415)
0810 21:08:17.858156 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:17.858181 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:17.858262 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:17.859151 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:17.859154 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:17.859560 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:17.859768 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:17.859774 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:17.861532 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:17.861533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:17.862351 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:17.862354 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:17.863098 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:17.863099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:17.863168 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:17.863966 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:08:17.863972 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:17.865709 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:17.868131 (+ 2422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:17.868140 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:17.868143 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:17.868530 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:17.868836 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:17.868836 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:17.868837 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:17.868972 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:17.869406 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:17.869406 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:17.869530 (+ 124us) client_negotiation.cc:769] Sending connection context
0810 21:08:17.869641 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 21:08:17.869853 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":24,"thread_start_us":100,"threads_started":1}
I20260810 21:08:17.870009 10543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:17.858076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:33415 (local address 127.15.37.3:41977)
0810 21:08:17.858281 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:17.858295 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:17.858340 (+ 45us) server_negotiation.cc:407] Connection header received
0810 21:08:17.858888 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:17.858892 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:17.858942 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:17.859108 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:17.859900 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:17.861433 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:17.862455 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:17.862961 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:17.863490 (+ 529us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:17.865836 (+ 2346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:17.865842 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:17.865843 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:17.865855 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:17.868036 (+ 2181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:17.868625 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:17.868630 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:17.868630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:17.868746 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:17.869047 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:17.869049 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:17.869049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:17.869310 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:17.869416 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:17.869707 (+ 291us) server_negotiation.cc:299] Negotiation successful
0810 21:08:17.869880 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":69,"threads_started":1}
I20260810 21:08:17.870080 10545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:17.858186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:37645 (local address 127.15.37.1:38905)
0810 21:08:17.858324 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:17.858334 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:17.858393 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:17.859151 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:17.859154 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:17.859559 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:17.859768 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:17.859774 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:17.861437 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:17.861438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:17.862347 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:17.862349 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:17.863017 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:17.863018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:17.863134 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:17.863904 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:08:17.863913 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:17.866331 (+ 2418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:17.868237 (+ 1906us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:17.868238 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:17.868238 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:17.868536 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:17.868832 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:17.868833 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:17.868833 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:17.868970 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:17.869387 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:17.869395 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:17.869534 (+ 139us) client_negotiation.cc:769] Sending connection context
0810 21:08:17.869643 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 21:08:17.869944 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":196,"thread_start_us":82,"threads_started":1}
W20260810 21:08:17.871444 9929 leader_election.cc:341] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977): Not found: Tablet not found: 25c56acd1baf49ab9da5079ac193af7b
W20260810 21:08:17.871553 9929 leader_election.cc:341] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645): Not found: Tablet not found: 25c56acd1baf49ab9da5079ac193af7b
I20260810 21:08:17.871603 9929 leader_election.cc:302] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f33c315554588ad48b5b3dbb4b228; no voters: d7b8260706254935bc95b955915d16b2, f0aee42985f14a5fb13079e2582cd08b
I20260810 21:08:17.871723 10537 raft_consensus.cc:2726] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 21:08:18.283874 10538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:18.283693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:56271)
0810 21:08:18.283784 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:18.283829 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 21:08:18.351454 10548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:18.351201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:59521)
0810 21:08:18.351337 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:18.351396 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":68,"threads_started":1}
I20260810 21:08:18.486781 10549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:18.486559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:35401)
0810 21:08:18.486690 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:18.486734 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":71,"threads_started":1}
I20260810 21:08:19.284827 10550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:19.284574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:48953)
0810 21:08:19.284724 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:19.284770 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":75,"threads_started":1}
I20260810 21:08:19.352386 10553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:19.352106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:40185)
0810 21:08:19.352274 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:19.352325 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":72,"threads_started":1}
I20260810 21:08:19.456553 10555 raft_consensus.cc:482] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:08:19.456679 10555 raft_consensus.cc:504] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:08:19.456888 10555 leader_election.cc:288] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977), d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645)
W20260810 21:08:19.457571 9929 leader_election.cc:341] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977): Not found: Tablet not found: 25c56acd1baf49ab9da5079ac193af7b
W20260810 21:08:19.457674 9929 leader_election.cc:341] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645): Not found: Tablet not found: 25c56acd1baf49ab9da5079ac193af7b
I20260810 21:08:19.457716 9929 leader_election.cc:302] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f33c315554588ad48b5b3dbb4b228; no voters: d7b8260706254935bc95b955915d16b2, f0aee42985f14a5fb13079e2582cd08b
I20260810 21:08:19.457814 10555 raft_consensus.cc:2726] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 21:08:19.487494 10559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:19.487257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:37513)
0810 21:08:19.487409 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:19.487448 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":100,"threads_started":1}
I20260810 21:08:20.285765 10560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:20.285478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:59913)
0810 21:08:20.285673 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:20.285712 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":132,"threads_started":1}
I20260810 21:08:20.353286 10561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:20.353013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:52611)
0810 21:08:20.353190 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:20.353236 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":95,"threads_started":1}
I20260810 21:08:20.488386 10562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:20.488047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:53369)
0810 21:08:20.488280 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:20.488331 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":119,"threads_started":1}
I20260810 21:08:21.084697 10563 raft_consensus.cc:482] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:08:21.084820 10563 raft_consensus.cc:504] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:08:21.085019 10563 leader_election.cc:288] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977), d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645)
W20260810 21:08:21.085565 9929 leader_election.cc:341] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977): Not found: Tablet not found: 25c56acd1baf49ab9da5079ac193af7b
W20260810 21:08:21.085685 9929 leader_election.cc:341] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645): Not found: Tablet not found: 25c56acd1baf49ab9da5079ac193af7b
I20260810 21:08:21.085712 9929 leader_election.cc:302] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f33c315554588ad48b5b3dbb4b228; no voters: d7b8260706254935bc95b955915d16b2, f0aee42985f14a5fb13079e2582cd08b
I20260810 21:08:21.085786 10563 raft_consensus.cc:2726] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 21:08:21.286732 10564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:21.286471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:49373)
0810 21:08:21.286626 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:21.286676 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":74,"threads_started":1}
I20260810 21:08:21.354178 10568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:21.353884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:56861)
0810 21:08:21.354061 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:21.354125 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":73,"threads_started":1}
I20260810 21:08:21.489213 10569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:21.488948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:52421)
0810 21:08:21.489113 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:21.489161 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":85,"threads_started":1}
I20260810 21:08:22.287714 10570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:22.287377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:59565)
0810 21:08:22.287580 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:22.287627 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":95,"threads_started":1}
I20260810 21:08:22.355083 10571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:22.354772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:44683)
0810 21:08:22.354978 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:22.355029 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":98,"threads_started":1}
I20260810 21:08:22.490022 10572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:22.489730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:49471)
0810 21:08:22.489889 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:22.489941 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":70,"threads_started":1}
I20260810 21:08:23.288730 10573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:23.288434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:41081)
0810 21:08:23.288633 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:23.288676 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":132,"threads_started":1}
I20260810 21:08:23.356082 10575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:23.355759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:49679)
0810 21:08:23.355977 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:23.356027 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":104,"threads_started":1}
I20260810 21:08:23.490897 10576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:23.490555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:55499)
0810 21:08:23.490734 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:23.490780 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":76,"threads_started":1}
I20260810 21:08:23.911127 10577 raft_consensus.cc:482] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:08:23.911257 10577 raft_consensus.cc:504] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:08:23.911485 10577 leader_election.cc:288] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977), d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645)
W20260810 21:08:23.912140 9929 leader_election.cc:341] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977): Not found: Tablet not found: 25c56acd1baf49ab9da5079ac193af7b
W20260810 21:08:23.912258 9929 leader_election.cc:341] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645): Not found: Tablet not found: 25c56acd1baf49ab9da5079ac193af7b
I20260810 21:08:23.912295 9929 leader_election.cc:302] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f33c315554588ad48b5b3dbb4b228; no voters: d7b8260706254935bc95b955915d16b2, f0aee42985f14a5fb13079e2582cd08b
I20260810 21:08:23.912410 10577 raft_consensus.cc:2726] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 21:08:24.289633 10579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:24.289305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:46535)
0810 21:08:24.289529 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:24.289583 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":93,"threads_started":1}
I20260810 21:08:24.357105 10585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:24.356818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:50375)
0810 21:08:24.356999 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:24.357048 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":76,"threads_started":1}
I20260810 21:08:24.491796 10587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:24.491537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:56249)
0810 21:08:24.491693 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:24.491744 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":70,"threads_started":1}
I20260810 21:08:25.290524 10589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:25.290242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:47401)
0810 21:08:25.290417 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:25.290470 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":80,"threads_started":1}
I20260810 21:08:25.358043 10590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:25.357724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:39391)
0810 21:08:25.357941 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:25.357990 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":116,"threads_started":1}
I20260810 21:08:25.492733 10592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:25.492417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:52125)
0810 21:08:25.492626 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:25.492677 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":140,"threads_started":1}
I20260810 21:08:26.291527 10594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:26.291232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:33599)
0810 21:08:26.291420 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:26.291469 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":78,"threads_started":1}
I20260810 21:08:26.358867 10595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:26.358626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:53887)
0810 21:08:26.358776 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:26.358812 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
I20260810 21:08:26.493708 10597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:26.493401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:49741)
0810 21:08:26.493603 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:26.493655 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":95,"threads_started":1}
I20260810 21:08:27.292587 10599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:27.292207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:51861)
0810 21:08:27.292402 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:27.292453 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":85,"threads_started":1}
I20260810 21:08:27.359704 10600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:27.359438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:48291)
0810 21:08:27.359608 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:27.359648 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":102,"threads_started":1}
I20260810 21:08:27.494580 10602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:27.494303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:49285)
0810 21:08:27.494479 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:27.494527 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":90,"threads_started":1}
I20260810 21:08:28.293419 10603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:28.293137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:43789)
0810 21:08:28.293314 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:28.293366 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":75,"threads_started":1}
I20260810 21:08:28.360570 10604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:28.360242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:47475)
0810 21:08:28.360419 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:28.360459 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":105,"threads_started":1}
I20260810 21:08:28.495417 10606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:28.495137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:60685)
0810 21:08:28.495319 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:28.495365 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":96,"threads_started":1}
I20260810 21:08:29.294267 10607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:29.293983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:59709)
0810 21:08:29.294170 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:29.294213 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":108,"threads_started":1}
I20260810 21:08:29.361471 10608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:29.361222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:40939)
0810 21:08:29.361372 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:29.361417 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":76,"threads_started":1}
I20260810 21:08:29.496188 10609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:29.495939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:33003)
0810 21:08:29.496094 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:29.496132 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":71,"threads_started":1}
I20260810 21:08:30.067405 10612 raft_consensus.cc:482] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:08:30.067569 10612 raft_consensus.cc:504] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0aee42985f14a5fb13079e2582cd08b" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41977 } } peers { permanent_uuid: "d7b8260706254935bc95b955915d16b2" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37645 } } peers { permanent_uuid: "178f33c315554588ad48b5b3dbb4b228" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 46057 } }
I20260810 21:08:30.067811 10612 leader_election.cc:288] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977), d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645)
W20260810 21:08:30.068380 9929 leader_election.cc:341] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7b8260706254935bc95b955915d16b2 (127.15.37.2:37645): Not found: Tablet not found: 25c56acd1baf49ab9da5079ac193af7b
W20260810 21:08:30.068450 9929 leader_election.cc:341] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f0aee42985f14a5fb13079e2582cd08b (127.15.37.3:41977): Not found: Tablet not found: 25c56acd1baf49ab9da5079ac193af7b
I20260810 21:08:30.068466 9929 leader_election.cc:302] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 178f33c315554588ad48b5b3dbb4b228; no voters: d7b8260706254935bc95b955915d16b2, f0aee42985f14a5fb13079e2582cd08b
I20260810 21:08:30.068606 10612 raft_consensus.cc:2726] T 25c56acd1baf49ab9da5079ac193af7b P 178f33c315554588ad48b5b3dbb4b228 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 21:08:30.295161 10615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:30.294841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:35567)
0810 21:08:30.295039 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:30.295105 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":101,"threads_started":1}
I20260810 21:08:30.362391 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:30.362080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:51651)
0810 21:08:30.362282 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:30.362333 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":99,"threads_started":1}
I20260810 21:08:30.497123 10618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:30.496817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:35583)
0810 21:08:30.496972 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:30.497040 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":99,"threads_started":1}
I20260810 21:08:31.296139 10619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:31.295889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.1:45671)
0810 21:08:31.296049 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:31.296089 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":95,"threads_started":1}
I20260810 21:08:31.363276 10620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:31.363046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.2:54381)
0810 21:08:31.363182 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:31.363225 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
I20260810 21:08:31.494271 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 9848
I20260810 21:08:31.499593 10621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:31.499352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:39625 (local address 127.15.37.3:51913)
0810 21:08:31.499485 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:31.499525 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.62:39625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":59,"threads_started":1}
I20260810 21:08:31.508059 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 10114
I20260810 21:08:31.514086 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 10322
2026-08-10T21:08:31Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58857 ms)
[----------] 30 tests from SecurityITest (256511 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:31 dist-test-slave-jq4t krb5kdc[10628](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:31 dist-test-slave-jq4t krb5kdc[10628](info): set up 2 sockets
Aug 10 21:08:31 dist-test-slave-jq4t krb5kdc[10628](info): commencing operation
krb5kdc: starting...
W20260810 21:08:32.817365 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.273s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:32 dist-test-slave-jq4t krb5kdc[10628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:08:32.951269 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:36715
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:33545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:36715
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:33.038784 10650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:33.039012 10650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:33.039036 10650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:33.040246 10650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:33.040297 10650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:33.040311 10650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:33.040325 10650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:33.040337 10650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:33.042129 10650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:33545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:36715
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:36715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:33.042423 10650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:33.042703 10650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:33.048250 10657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:33.048223 10660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:33.048418 10650 server_base.cc:1034] running on GCE node
W20260810 21:08:33.048215 10656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:33.048892 10650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:33.049266 10650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:33.050460 10650 hybrid_clock.cc:648] HybridClock initialized: now 1786396113050448 us; error 37 us; skew 500 ppm
Aug 10 21:08:33 dist-test-slave-jq4t krb5kdc[10628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396113, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:33.053498 10650 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:08:33.054081 10650 webserver.cc:460] Webserver started at http://127.15.37.62:43103/ using document root <none> and password file <none>
I20260810 21:08:33.054369 10650 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:33.054445 10650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:33.054605 10650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:33.055765 10650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "f3dfadc5ef4d4b92a76cf8f3e030b7bd"
format_stamp: "Formatted at 2026-08-10 21:08:33 on dist-test-slave-jq4t"
server_key: "8f045cd7b33e2f1c89a854b685bfded1"
server_key_iv: "eb46dfbfd2131a6365edea21e4aa0e20"
server_key_version: "encryptionkey@0"
I20260810 21:08:33.056169 10650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "f3dfadc5ef4d4b92a76cf8f3e030b7bd"
format_stamp: "Formatted at 2026-08-10 21:08:33 on dist-test-slave-jq4t"
server_key: "8f045cd7b33e2f1c89a854b685bfded1"
server_key_iv: "eb46dfbfd2131a6365edea21e4aa0e20"
server_key_version: "encryptionkey@0"
I20260810 21:08:33.057878 10650 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260810 21:08:33.058723 10669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:33.058941 10650 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:33.059065 10650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "f3dfadc5ef4d4b92a76cf8f3e030b7bd"
format_stamp: "Formatted at 2026-08-10 21:08:33 on dist-test-slave-jq4t"
server_key: "8f045cd7b33e2f1c89a854b685bfded1"
server_key_iv: "eb46dfbfd2131a6365edea21e4aa0e20"
server_key_version: "encryptionkey@0"
I20260810 21:08:33.059149 10650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:33.068240 10650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:33.070292 10650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:33.070469 10650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:33.074699 10650 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:36715
I20260810 21:08:33.074750 10751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:36715 every 8 connection(s)
I20260810 21:08:33.075160 10650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:33.076136 10754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:33.077481 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 10650
I20260810 21:08:33.077623 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:33.077813 15508 external_mini_cluster.cc:1428] Setting key a52e76fd99140536a3827e9caf95f4fb
I20260810 21:08:33.079010 10754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd: Bootstrap starting.
I20260810 21:08:33.079851 10754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:33.080214 10754 log.cc:824] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:33.081017 10754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd: No bootstrap required, opened a new log
I20260810 21:08:33.083554 10754 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3dfadc5ef4d4b92a76cf8f3e030b7bd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36715 } }
I20260810 21:08:33.083747 10754 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:33.083788 10754 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3dfadc5ef4d4b92a76cf8f3e030b7bd, State: Initialized, Role: FOLLOWER
I20260810 21:08:33.083945 10754 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3dfadc5ef4d4b92a76cf8f3e030b7bd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36715 } }
I20260810 21:08:33.084043 10754 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:33.084088 10754 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:33.084148 10754 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:33.084952 10754 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3dfadc5ef4d4b92a76cf8f3e030b7bd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36715 } }
I20260810 21:08:33.085049 10754 leader_election.cc:302] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3dfadc5ef4d4b92a76cf8f3e030b7bd; no voters:
Aug 10 21:08:33 dist-test-slave-jq4t krb5kdc[10628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:08:33.085273 10754 leader_election.cc:288] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:33.085299 10763 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:33.085470 10763 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [term 1 LEADER]: Becoming Leader. State: Replica: f3dfadc5ef4d4b92a76cf8f3e030b7bd, State: Running, Role: LEADER
I20260810 21:08:33.085564 10763 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3dfadc5ef4d4b92a76cf8f3e030b7bd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36715 } }
I20260810 21:08:33.085610 10754 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:33.085894 10763 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3dfadc5ef4d4b92a76cf8f3e030b7bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3dfadc5ef4d4b92a76cf8f3e030b7bd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36715 } } }
I20260810 21:08:33.085968 10763 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:33.086108 10763 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3dfadc5ef4d4b92a76cf8f3e030b7bd. Latest consensus state: current_term: 1 leader_uuid: "f3dfadc5ef4d4b92a76cf8f3e030b7bd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3dfadc5ef4d4b92a76cf8f3e030b7bd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36715 } } }
I20260810 21:08:33.086259 10763 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:33.086452 10772 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:33.086987 10772 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:33.088826 10772 catalog_manager.cc:1347] Generated new cluster ID: 5353ac1863aa422a98c91249705bb2b5
I20260810 21:08:33.088882 10772 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:08:33.089880 10760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.078417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55902 (local address 127.15.37.62:36715)
0810 21:08:33.078608 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:33.078615 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:33.078641 (+ 26us) server_negotiation.cc:407] Connection header received
0810 21:08:33.079062 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:33.079068 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:33.079137 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:33.079279 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:33.080142 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.081281 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.082351 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.082767 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.082858 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.085881 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:33.085885 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:33.085886 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:33.085904 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:33.088134 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:33.088597 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:33.088601 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:33.088601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:33.088710 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:33.088923 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:33.088923 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:33.088924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:33.089227 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:33.089396 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:33.089529 (+ 133us) server_negotiation.cc:299] Negotiation successful
0810 21:08:33.089676 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":100,"threads_started":1}
I20260810 21:08:33.096886 10772 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:33.097666 10772 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:33.110034 10772 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd: Generated new TSK 0
I20260810 21:08:33.110308 10772 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:08:33.145802 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36715
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:33545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:33.236267 10801 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:33.236611 10801 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:33.236646 10801 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:33.237887 10801 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:33.237936 10801 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:33.237963 10801 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:08:33.239471 10801 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:33545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36715
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10801
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:33.239692 10801 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:33.239897 10801 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:33.245630 10811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:33.245661 10808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:33.245635 10809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:33.245880 10801 server_base.cc:1034] running on GCE node
I20260810 21:08:33.246186 10801 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:33.246486 10801 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:33.247670 10801 hybrid_clock.cc:648] HybridClock initialized: now 1786396113247645 us; error 39 us; skew 500 ppm
Aug 10 21:08:33 dist-test-slave-jq4t krb5kdc[10628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396113, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:33.250434 10801 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:08:33.250984 10801 webserver.cc:460] Webserver started at http://127.15.37.1:44935/ using document root <none> and password file <none>
I20260810 21:08:33.251231 10801 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:33.251304 10801 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:33.251474 10801 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:33.252765 10801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "c9836a90be88423b89639a1ccd16e7da"
format_stamp: "Formatted at 2026-08-10 21:08:33 on dist-test-slave-jq4t"
server_key: "5a082d5e687f4b2074a5d4e0a900211b"
server_key_iv: "8bebaa99691f8c3c6d3555f5303d54ff"
server_key_version: "encryptionkey@0"
I20260810 21:08:33.253157 10801 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "c9836a90be88423b89639a1ccd16e7da"
format_stamp: "Formatted at 2026-08-10 21:08:33 on dist-test-slave-jq4t"
server_key: "5a082d5e687f4b2074a5d4e0a900211b"
server_key_iv: "8bebaa99691f8c3c6d3555f5303d54ff"
server_key_version: "encryptionkey@0"
I20260810 21:08:33.254699 10801 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:08:33.255614 10821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:33.255832 10801 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:33.255944 10801 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "c9836a90be88423b89639a1ccd16e7da"
format_stamp: "Formatted at 2026-08-10 21:08:33 on dist-test-slave-jq4t"
server_key: "5a082d5e687f4b2074a5d4e0a900211b"
server_key_iv: "8bebaa99691f8c3c6d3555f5303d54ff"
server_key_version: "encryptionkey@0"
I20260810 21:08:33.256053 10801 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:33.271839 10801 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:33.274547 10801 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:33.274742 10801 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:33.275025 10801 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:33.275384 10801 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:33.275440 10801 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:33.275514 10801 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:33.275547 10801 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:33.282078 10801 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:43419
I20260810 21:08:33.282126 11004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:43419 every 8 connection(s)
I20260810 21:08:33.282521 10801 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
Aug 10 21:08:33 dist-test-slave-jq4t krb5kdc[10628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396113, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:08:33.292632 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 10801
I20260810 21:08:33.292791 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:08:33.292943 10760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.283418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:39121 (local address 127.15.37.62:36715)
0810 21:08:33.283495 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:33.283498 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:33.283741 (+ 243us) server_negotiation.cc:407] Connection header received
0810 21:08:33.284240 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:33.284242 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:33.284252 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:33.284304 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:33.285378 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.286038 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.287258 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.287508 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.287575 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.289947 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:33.289949 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:33.289949 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:33.289957 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:33.291315 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:33.291743 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:33.291744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:33.291745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:33.291811 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:33.292109 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:33.292110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:33.292110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:33.292231 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:33.292284 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:33.292710 (+ 426us) server_negotiation.cc:299] Negotiation successful
0810 21:08:33.292837 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 21:08:33.293087 15508 external_mini_cluster.cc:1428] Setting key 702207744255610a5e8ffeca832a0b31
I20260810 21:08:33.293107 11007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.283395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36715 (local address 127.15.37.1:39121)
0810 21:08:33.283603 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:33.283644 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:33.284148 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:33.284366 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:33.284369 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:33.285063 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:33.285276 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.285281 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.286152 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.286153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.287101 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.287103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.287597 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.287598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.287709 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.288340 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:08:33.288350 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:33.289850 (+ 1500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:33.291404 (+ 1554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:33.291413 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:33.291415 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:33.291662 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:33.291908 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:33.291909 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:33.291910 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:33.292040 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:33.292292 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:33.292298 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:33.292442 (+ 144us) client_negotiation.cc:769] Sending connection context
0810 21:08:33.292652 (+ 210us) client_negotiation.cc:240] Negotiation successful
0810 21:08:33.292871 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":115,"threads_started":1}
I20260810 21:08:33.293756 11005 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36715
I20260810 21:08:33.293907 11005 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:33.294111 11005 heartbeater.cc:511] Master 127.15.37.62:36715 requested a full tablet report, sending...
I20260810 21:08:33.294739 10698 ts_manager.cc:194] Registered new tserver with Master: c9836a90be88423b89639a1ccd16e7da (127.15.37.1:43419)
I20260810 21:08:33.295668 10698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:39121
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:08:33.324136 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36715
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:33545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:33.418295 11013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:33.418618 11013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:33.418669 11013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:33.420043 11013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:33.420132 11013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:33.420177 11013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:08:33.421875 11013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:33545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36715
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:33.422217 11013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:33.422497 11013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:33.428251 11021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:33.428259 11019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:33.428375 11013 server_base.cc:1034] running on GCE node
W20260810 21:08:33.428279 11023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:33.428704 11013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:33.428931 11013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:33.430104 11013 hybrid_clock.cc:648] HybridClock initialized: now 1786396113430082 us; error 45 us; skew 500 ppm
Aug 10 21:08:33 dist-test-slave-jq4t krb5kdc[10628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396113, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:33.432871 11013 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:08:33.433395 11013 webserver.cc:460] Webserver started at http://127.15.37.2:38937/ using document root <none> and password file <none>
I20260810 21:08:33.433676 11013 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:33.433749 11013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:33.433915 11013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:33.435051 11013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "9e2d0ca8cb364212b6c6b772ec10715d"
format_stamp: "Formatted at 2026-08-10 21:08:33 on dist-test-slave-jq4t"
server_key: "1b0d3b2522017f1d03f0c32d08d036d4"
server_key_iv: "414cfb5d09983f38f8930680d8dc82f5"
server_key_version: "encryptionkey@0"
I20260810 21:08:33.435438 11013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "9e2d0ca8cb364212b6c6b772ec10715d"
format_stamp: "Formatted at 2026-08-10 21:08:33 on dist-test-slave-jq4t"
server_key: "1b0d3b2522017f1d03f0c32d08d036d4"
server_key_iv: "414cfb5d09983f38f8930680d8dc82f5"
server_key_version: "encryptionkey@0"
I20260810 21:08:33.437101 11013 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:08:33.437919 11032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:33.438243 11013 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:33.438356 11013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "9e2d0ca8cb364212b6c6b772ec10715d"
format_stamp: "Formatted at 2026-08-10 21:08:33 on dist-test-slave-jq4t"
server_key: "1b0d3b2522017f1d03f0c32d08d036d4"
server_key_iv: "414cfb5d09983f38f8930680d8dc82f5"
server_key_version: "encryptionkey@0"
I20260810 21:08:33.438437 11013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:33.462431 11013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:33.464895 11013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:33.465077 11013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:33.465344 11013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:33.465692 11013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:33.465750 11013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:33.465797 11013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:33.465821 11013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:33.472342 11013 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:33721
I20260810 21:08:33.472396 11220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:33721 every 8 connection(s)
I20260810 21:08:33.472792 11013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
Aug 10 21:08:33 dist-test-slave-jq4t krb5kdc[10628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396113, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:08:33.481133 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 11013
I20260810 21:08:33.481293 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:08:33.481509 15508 external_mini_cluster.cc:1428] Setting key 3127110f082b553729dae90722fa1cfe
I20260810 21:08:33.483439 10760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.473616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:49921 (local address 127.15.37.62:36715)
0810 21:08:33.473700 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:33.473703 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:33.473923 (+ 220us) server_negotiation.cc:407] Connection header received
0810 21:08:33.474466 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:33.474468 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:33.474479 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:33.474550 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:33.475644 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.476211 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.477381 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.477584 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.477653 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.480067 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:33.480068 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:33.480068 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:33.480076 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:33.481899 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:33.482292 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:33.482293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:33.482294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:33.482361 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:33.482730 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:33.482731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:33.482732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:33.482856 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:33.482910 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:33.483297 (+ 387us) server_negotiation.cc:299] Negotiation successful
0810 21:08:33.483372 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 21:08:33.483809 11223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.473572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36715 (local address 127.15.37.2:49921)
0810 21:08:33.473778 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:33.473824 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:33.474368 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:33.474633 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:33.474636 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:33.475250 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:33.475541 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.475546 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.476302 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.476302 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.477253 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.477255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.477675 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.477676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.477796 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.478372 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:08:33.478382 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:33.479964 (+ 1582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:33.481977 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:33.481986 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:33.481988 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:33.482227 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:33.482434 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:33.482435 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:33.482435 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:33.482608 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:33.482925 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:33.482934 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:33.483129 (+ 195us) client_negotiation.cc:769] Sending connection context
0810 21:08:33.483284 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 21:08:33.483500 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":122,"threads_started":1}
I20260810 21:08:33.484392 11221 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36715
I20260810 21:08:33.484558 11221 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:33.484778 11221 heartbeater.cc:511] Master 127.15.37.62:36715 requested a full tablet report, sending...
I20260810 21:08:33.485229 10698 ts_manager.cc:194] Registered new tserver with Master: 9e2d0ca8cb364212b6c6b772ec10715d (127.15.37.2:33721)
I20260810 21:08:33.485749 10698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:49921
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:08:33.512626 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36715
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:33545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:33.603343 11226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:33.603582 11226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:33.603609 11226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:33.604873 11226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:33.604926 11226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:33.604955 11226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:08:33.606510 11226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:33545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36715
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:33.606734 11226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:33.606948 11226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:33.612581 11235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:33.612648 11226 server_base.cc:1034] running on GCE node
W20260810 21:08:33.612586 11236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:33.612588 11238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:33.613035 11226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:33.613353 11226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:33.614558 11226 hybrid_clock.cc:648] HybridClock initialized: now 1786396113614541 us; error 43 us; skew 500 ppm
Aug 10 21:08:33 dist-test-slave-jq4t krb5kdc[10628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396113, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:33.617373 11226 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:08:33.617858 11226 webserver.cc:460] Webserver started at http://127.15.37.3:46445/ using document root <none> and password file <none>
I20260810 21:08:33.618136 11226 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:33.618212 11226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:33.618383 11226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:33.619668 11226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "e214cd8c55224efba9df698e72e35926"
format_stamp: "Formatted at 2026-08-10 21:08:33 on dist-test-slave-jq4t"
server_key: "549c6efcdeab7157808a17d01fcef160"
server_key_iv: "84391277066f05283326205c99ce3a95"
server_key_version: "encryptionkey@0"
I20260810 21:08:33.620062 11226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "e214cd8c55224efba9df698e72e35926"
format_stamp: "Formatted at 2026-08-10 21:08:33 on dist-test-slave-jq4t"
server_key: "549c6efcdeab7157808a17d01fcef160"
server_key_iv: "84391277066f05283326205c99ce3a95"
server_key_version: "encryptionkey@0"
I20260810 21:08:33.621615 11226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260810 21:08:33.622445 11251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:33.622632 11226 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:33.622746 11226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "e214cd8c55224efba9df698e72e35926"
format_stamp: "Formatted at 2026-08-10 21:08:33 on dist-test-slave-jq4t"
server_key: "549c6efcdeab7157808a17d01fcef160"
server_key_iv: "84391277066f05283326205c99ce3a95"
server_key_version: "encryptionkey@0"
I20260810 21:08:33.622826 11226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:33.633503 11226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:33.635547 11226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:33.635728 11226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:33.635990 11226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:33.636327 11226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:33.636385 11226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:33.636432 11226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:33.636458 11226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:33.643337 11226 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:35723
I20260810 21:08:33.643425 11428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:35723 every 8 connection(s)
I20260810 21:08:33.643887 11226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:08:33.649343 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 11226
I20260810 21:08:33.649492 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:08:33.649772 15508 external_mini_cluster.cc:1428] Setting key 7eb644d6f4815b7daaa03dfa35e4db4a
Aug 10 21:08:33 dist-test-slave-jq4t krb5kdc[10628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396113, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:08:33.654302 10760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.644772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:45979 (local address 127.15.37.62:36715)
0810 21:08:33.644830 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:33.644832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:33.645117 (+ 285us) server_negotiation.cc:407] Connection header received
0810 21:08:33.645696 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:33.645697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:33.645712 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:33.645764 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:33.646798 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.647329 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.648432 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.648729 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.648810 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.651690 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:33.651692 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:33.651692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:33.651699 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:33.653028 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:33.653451 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:33.653452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:33.653452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:33.653505 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:33.653731 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:33.653732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:33.653732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:33.653845 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:33.653899 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:33.654164 (+ 265us) server_negotiation.cc:299] Negotiation successful
0810 21:08:33.654233 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 21:08:33.654556 11431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.644796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36715 (local address 127.15.37.3:45979)
0810 21:08:33.644976 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:33.645015 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:33.645573 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:33.645839 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:33.645843 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:33.646473 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:33.646687 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.646692 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.647444 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.647445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.648331 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.648333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.648822 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.648824 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.649013 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.649718 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:08:33.649729 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:33.651602 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:33.653109 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:33.653117 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:33.653120 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:33.653382 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:33.653567 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:33.653567 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:33.653568 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:33.653674 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:33.653902 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:33.653907 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:33.654040 (+ 133us) client_negotiation.cc:769] Sending connection context
0810 21:08:33.654127 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 21:08:33.654269 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260810 21:08:33.655133 11429 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36715
I20260810 21:08:33.655241 11429 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:33.655409 11429 heartbeater.cc:511] Master 127.15.37.62:36715 requested a full tablet report, sending...
I20260810 21:08:33.655838 10698 ts_manager.cc:194] Registered new tserver with Master: e214cd8c55224efba9df698e72e35926 (127.15.37.3:35723)
I20260810 21:08:33.656196 10698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:45979
I20260810 21:08:33.661945 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:08:33.669339 10760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.663491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55908 (local address 127.15.37.62:36715)
0810 21:08:33.663554 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:33.663557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:33.663655 (+ 98us) server_negotiation.cc:407] Connection header received
0810 21:08:33.663702 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:33.663702 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:33.663713 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:33.663769 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:33.664337 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.664925 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.665631 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.665817 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.665872 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.667069 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:33.667070 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:33.667071 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:33.667077 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:33.668291 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:33.668687 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:33.668688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:33.668688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:33.668742 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:33.668898 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:33.668898 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:33.668898 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:33.669045 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:33.669117 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:33.669208 (+ 91us) server_negotiation.cc:299] Negotiation successful
0810 21:08:33.669270 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 21:08:33.671015 10698 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55908:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:08:33.672760 10698 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:08:33.680341 11457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.676142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36294 (local address 127.15.37.1:43419)
0810 21:08:33.676386 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:33.676390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:33.676400 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:08:33.676442 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:33.676444 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:33.676457 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:33.676587 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:33.676712 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.677885 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.679370 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.679890 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.679989 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.680065 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:33.680204 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 21:08:33.680248 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":95,"threads_started":1}
I20260810 21:08:33.680330 11456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.675817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:43419 (local address 127.0.0.1:36294)
0810 21:08:33.676136 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:33.676148 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:33.676197 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:33.676588 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:33.676589 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:33.676591 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:33.676653 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.676655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.678039 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.678040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.679260 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.679263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.679992 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.679993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.680078 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.680094 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 21:08:33.680171 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 21:08:33.680237 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":5,"thread_start_us":130,"threads_started":1}
I20260810 21:08:33.680642 11443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.675590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:33721 (local address 127.0.0.1:55292)
0810 21:08:33.676025 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:33.676036 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:33.676093 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:33.676692 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:33.676692 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:33.676695 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:33.676735 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.676737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.678040 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.678041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.679261 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.679263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.680354 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.680355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.680422 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.680427 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:08:33.680510 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 21:08:33.680559 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":82,"thread_start_us":104,"threads_started":1}
I20260810 21:08:33.680938 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.675843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55292 (local address 127.15.37.2:33721)
0810 21:08:33.676341 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:33.676345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:33.676355 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:08:33.676417 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:33.676419 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:33.676438 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:33.676596 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:33.676837 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.677930 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.679371 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.680180 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.680258 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.680316 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:33.680776 (+ 460us) server_negotiation.cc:299] Negotiation successful
0810 21:08:33.680838 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":85,"threads_started":1}
I20260810 21:08:33.680927 11446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.675703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58750 (local address 127.15.37.3:35723)
0810 21:08:33.676235 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:33.676241 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:33.676252 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:08:33.676297 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:33.676299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:33.676317 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:33.676422 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:33.676692 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.677550 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.679116 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.679940 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.680023 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.680084 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:33.680633 (+ 549us) server_negotiation.cc:299] Negotiation successful
0810 21:08:33.680693 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":114,"threads_started":1}
I20260810 21:08:33.681123 11444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.675590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:35723 (local address 127.0.0.1:58750)
0810 21:08:33.675782 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:33.675829 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:33.675908 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:33.676446 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:33.676449 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:33.676452 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:33.676589 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.676592 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.677671 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.677672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.679009 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.679013 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.680126 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.680127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.680201 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.680206 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:08:33.680261 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 21:08:33.680313 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":205,"thread_start_us":67,"threads_started":1}
I20260810 21:08:33.681767 11114 tablet_service.cc:1467] Processing CreateTablet for tablet 5245247a782446ffb1c910a256027ee9 (DEFAULT_TABLE table=test-table [id=44a676e376d440459330efa503f0a824]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:33.681772 10908 tablet_service.cc:1467] Processing CreateTablet for tablet 5245247a782446ffb1c910a256027ee9 (DEFAULT_TABLE table=test-table [id=44a676e376d440459330efa503f0a824]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:33.682164 11114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5245247a782446ffb1c910a256027ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:33.682169 10908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5245247a782446ffb1c910a256027ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:33.684360 11330 tablet_service.cc:1467] Processing CreateTablet for tablet 5245247a782446ffb1c910a256027ee9 (DEFAULT_TABLE table=test-table [id=44a676e376d440459330efa503f0a824]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:33.684818 11330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5245247a782446ffb1c910a256027ee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:33.685571 11461 tablet_bootstrap.cc:492] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d: Bootstrap starting.
I20260810 21:08:33.686023 11462 tablet_bootstrap.cc:492] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da: Bootstrap starting.
I20260810 21:08:33.686558 11461 tablet_bootstrap.cc:654] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:33.686825 11462 tablet_bootstrap.cc:654] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:33.687536 11461 log.cc:824] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:33.687536 11462 log.cc:824] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:33.688549 11462 tablet_bootstrap.cc:492] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da: No bootstrap required, opened a new log
I20260810 21:08:33.688637 11462 ts_tablet_manager.cc:1397] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:08:33.688740 11461 tablet_bootstrap.cc:492] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d: No bootstrap required, opened a new log
I20260810 21:08:33.688812 11461 ts_tablet_manager.cc:1397] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:08:33.689147 11467 tablet_bootstrap.cc:492] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926: Bootstrap starting.
I20260810 21:08:33.689877 11467 tablet_bootstrap.cc:654] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:33.690434 11467 log.cc:824] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:33.690846 11461 raft_consensus.cc:348] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e214cd8c55224efba9df698e72e35926" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 35723 } } peers { permanent_uuid: "c9836a90be88423b89639a1ccd16e7da" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43419 } } peers { permanent_uuid: "9e2d0ca8cb364212b6c6b772ec10715d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33721 } }
I20260810 21:08:33.690797 11462 raft_consensus.cc:348] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e214cd8c55224efba9df698e72e35926" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 35723 } } peers { permanent_uuid: "c9836a90be88423b89639a1ccd16e7da" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43419 } } peers { permanent_uuid: "9e2d0ca8cb364212b6c6b772ec10715d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33721 } }
I20260810 21:08:33.691035 11462 raft_consensus.cc:374] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:33.691030 11461 raft_consensus.cc:374] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:33.691072 11462 raft_consensus.cc:729] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9836a90be88423b89639a1ccd16e7da, State: Initialized, Role: FOLLOWER
I20260810 21:08:33.691072 11461 raft_consensus.cc:729] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e2d0ca8cb364212b6c6b772ec10715d, State: Initialized, Role: FOLLOWER
I20260810 21:08:33.691226 11462 consensus_queue.cc:260] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e214cd8c55224efba9df698e72e35926" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 35723 } } peers { permanent_uuid: "c9836a90be88423b89639a1ccd16e7da" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43419 } } peers { permanent_uuid: "9e2d0ca8cb364212b6c6b772ec10715d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33721 } }
I20260810 21:08:33.691227 11461 consensus_queue.cc:260] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e214cd8c55224efba9df698e72e35926" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 35723 } } peers { permanent_uuid: "c9836a90be88423b89639a1ccd16e7da" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43419 } } peers { permanent_uuid: "9e2d0ca8cb364212b6c6b772ec10715d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33721 } }
I20260810 21:08:33.691540 11462 ts_tablet_manager.cc:1428] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:08:33.691540 11461 ts_tablet_manager.cc:1428] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:08:33.691555 11467 tablet_bootstrap.cc:492] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926: No bootstrap required, opened a new log
I20260810 21:08:33.691689 11005 heartbeater.cc:503] Master 127.15.37.62:36715 was elected leader, sending a full tablet report...
I20260810 21:08:33.691797 11221 heartbeater.cc:503] Master 127.15.37.62:36715 was elected leader, sending a full tablet report...
I20260810 21:08:33.691989 11467 ts_tablet_manager.cc:1397] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:08:33.694205 11467 raft_consensus.cc:348] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e214cd8c55224efba9df698e72e35926" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 35723 } } peers { permanent_uuid: "c9836a90be88423b89639a1ccd16e7da" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43419 } } peers { permanent_uuid: "9e2d0ca8cb364212b6c6b772ec10715d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33721 } }
I20260810 21:08:33.694411 11467 raft_consensus.cc:374] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:33.694466 11467 raft_consensus.cc:729] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e214cd8c55224efba9df698e72e35926, State: Initialized, Role: FOLLOWER
I20260810 21:08:33.694603 11467 consensus_queue.cc:260] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e214cd8c55224efba9df698e72e35926" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 35723 } } peers { permanent_uuid: "c9836a90be88423b89639a1ccd16e7da" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43419 } } peers { permanent_uuid: "9e2d0ca8cb364212b6c6b772ec10715d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33721 } }
I20260810 21:08:33.694940 11467 ts_tablet_manager.cc:1428] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:08:33.695015 11429 heartbeater.cc:503] Master 127.15.37.62:36715 was elected leader, sending a full tablet report...
W20260810 21:08:33.723449 11222 tablet.cc:2369] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:08:33.783440 11006 tablet.cc:2369] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:08:33.857085 11472 raft_consensus.cc:482] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:08:33.857241 11472 raft_consensus.cc:504] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e214cd8c55224efba9df698e72e35926" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 35723 } } peers { permanent_uuid: "c9836a90be88423b89639a1ccd16e7da" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43419 } } peers { permanent_uuid: "9e2d0ca8cb364212b6c6b772ec10715d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33721 } }
I20260810 21:08:33.857885 11472 leader_election.cc:288] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9836a90be88423b89639a1ccd16e7da (127.15.37.1:43419), 9e2d0ca8cb364212b6c6b772ec10715d (127.15.37.2:33721)
I20260810 21:08:33.861896 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.857975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:41787 (local address 127.15.37.2:33721)
0810 21:08:33.858029 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:33.858031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:33.858445 (+ 414us) server_negotiation.cc:407] Connection header received
0810 21:08:33.858530 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:33.858532 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:33.858546 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:33.858606 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:33.858780 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.859470 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.860835 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.861447 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.861529 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.861543 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:33.861779 (+ 236us) server_negotiation.cc:299] Negotiation successful
0810 21:08:33.861826 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 21:08:33.861896 11431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.857862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:43419 (local address 127.15.37.3:39753)
0810 21:08:33.857986 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:33.858000 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:33.858051 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:33.858339 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:33.858340 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:33.858343 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:33.858430 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.858433 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.859397 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.859399 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.860726 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.860729 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.861590 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.861591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.861665 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.861672 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 21:08:33.861717 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 21:08:33.861793 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":7}
I20260810 21:08:33.861919 11457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.858107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:39753 (local address 127.15.37.1:43419)
0810 21:08:33.858193 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:33.858196 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:33.858206 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:08:33.858237 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:33.858238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:33.858255 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:33.858321 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:33.858511 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.859323 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.860858 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.861470 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.861530 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.861542 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:33.861752 (+ 210us) server_negotiation.cc:299] Negotiation successful
0810 21:08:33.861808 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 21:08:33.861914 11473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.857862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:33721 (local address 127.15.37.3:41787)
0810 21:08:33.858357 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:33.858369 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:33.858449 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:33.858623 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:33.858624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:33.858630 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:33.858707 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.858708 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.859543 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.859544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.860726 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:33.860729 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.861592 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.861593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:33.861665 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.861672 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 21:08:33.861762 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 21:08:33.861807 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"mutex_wait_us":239,"thread_start_us":148,"threads_started":1}
I20260810 21:08:33.862329 11141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5245247a782446ffb1c910a256027ee9" candidate_uuid: "e214cd8c55224efba9df698e72e35926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2d0ca8cb364212b6c6b772ec10715d" is_pre_election: true
I20260810 21:08:33.862396 10933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5245247a782446ffb1c910a256027ee9" candidate_uuid: "e214cd8c55224efba9df698e72e35926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9836a90be88423b89639a1ccd16e7da" is_pre_election: true
I20260810 21:08:33.862524 11141 raft_consensus.cc:2454] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e214cd8c55224efba9df698e72e35926 in term 0.
I20260810 21:08:33.862604 10933 raft_consensus.cc:2454] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e214cd8c55224efba9df698e72e35926 in term 0.
I20260810 21:08:33.862850 11254 leader_election.cc:302] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e2d0ca8cb364212b6c6b772ec10715d, e214cd8c55224efba9df698e72e35926; no voters:
I20260810 21:08:33.863018 11472 raft_consensus.cc:2781] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:08:33.863078 11472 raft_consensus.cc:482] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:08:33.863095 11472 raft_consensus.cc:3037] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:33.863932 11472 raft_consensus.cc:504] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e214cd8c55224efba9df698e72e35926" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 35723 } } peers { permanent_uuid: "c9836a90be88423b89639a1ccd16e7da" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43419 } } peers { permanent_uuid: "9e2d0ca8cb364212b6c6b772ec10715d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33721 } }
I20260810 21:08:33.864162 11472 leader_election.cc:288] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [CANDIDATE]: Term 1 election: Requested vote from peers c9836a90be88423b89639a1ccd16e7da (127.15.37.1:43419), 9e2d0ca8cb364212b6c6b772ec10715d (127.15.37.2:33721)
I20260810 21:08:33.864290 10933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5245247a782446ffb1c910a256027ee9" candidate_uuid: "e214cd8c55224efba9df698e72e35926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9836a90be88423b89639a1ccd16e7da"
I20260810 21:08:33.864363 10933 raft_consensus.cc:3037] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:33.864346 11141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5245247a782446ffb1c910a256027ee9" candidate_uuid: "e214cd8c55224efba9df698e72e35926" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e2d0ca8cb364212b6c6b772ec10715d"
I20260810 21:08:33.864419 11141 raft_consensus.cc:3037] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:33.865175 10933 raft_consensus.cc:2454] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e214cd8c55224efba9df698e72e35926 in term 1.
I20260810 21:08:33.865296 11141 raft_consensus.cc:2454] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e214cd8c55224efba9df698e72e35926 in term 1.
I20260810 21:08:33.865393 11258 leader_election.cc:302] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9836a90be88423b89639a1ccd16e7da, e214cd8c55224efba9df698e72e35926; no voters:
I20260810 21:08:33.865489 11472 raft_consensus.cc:2781] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:33.865657 11472 raft_consensus.cc:686] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [term 1 LEADER]: Becoming Leader. State: Replica: e214cd8c55224efba9df698e72e35926, State: Running, Role: LEADER
I20260810 21:08:33.865768 11472 consensus_queue.cc:237] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e214cd8c55224efba9df698e72e35926" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 35723 } } peers { permanent_uuid: "c9836a90be88423b89639a1ccd16e7da" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43419 } } peers { permanent_uuid: "9e2d0ca8cb364212b6c6b772ec10715d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33721 } }
I20260810 21:08:33.866737 10695 catalog_manager.cc:5495] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 reported cstate change: term changed from 0 to 1, leader changed from <none> to e214cd8c55224efba9df698e72e35926 (127.15.37.3). New cstate: current_term: 1 leader_uuid: "e214cd8c55224efba9df698e72e35926" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e214cd8c55224efba9df698e72e35926" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 35723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9836a90be88423b89639a1ccd16e7da" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e2d0ca8cb364212b6c6b772ec10715d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33721 } health_report { overall_health: UNKNOWN } } }
W20260810 21:08:33.894584 11430 tablet.cc:2369] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:08:33.908320 11446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.905606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58758 (local address 127.15.37.3:35723)
0810 21:08:33.905663 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:33.905665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:33.905675 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:08:33.905804 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:33.905805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:33.905862 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:33.905956 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:08:33.906127 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.906633 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.907456 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:33.907664 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:33.907746 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:33.907946 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:08:33.908066 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:08:33.908169 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:33.908189 (+ 20us) server_negotiation.cc:299] Negotiation successful
0810 21:08:33.908214 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 21:08:33.910478 10933 raft_consensus.cc:1261] T 5245247a782446ffb1c910a256027ee9 P c9836a90be88423b89639a1ccd16e7da [term 1 FOLLOWER]: Refusing update from remote peer e214cd8c55224efba9df698e72e35926: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:08:33.910478 11141 raft_consensus.cc:1261] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d [term 1 FOLLOWER]: Refusing update from remote peer e214cd8c55224efba9df698e72e35926: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:08:33.910977 11474 consensus_queue.cc:1035] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e2d0ca8cb364212b6c6b772ec10715d" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 33721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:08:33.911204 11472 consensus_queue.cc:1035] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9836a90be88423b89639a1ccd16e7da" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:08:33.914965 11483 mvcc.cc:205] Tried to move back new op lower bound from 7317078482574069760 to 7317078482394976256. Current Snapshot: MvccSnapshot[applied={T|T < 7317078482574069760 or (T in {7317078482574069760})}]
I20260810 21:08:33.916252 10694 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55908:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:08:33.916364 10694 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55908:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:08:33.917254 10694 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f3dfadc5ef4d4b92a76cf8f3e030b7bd: Sending DeleteTablet for 3 replicas of tablet 5245247a782446ffb1c910a256027ee9
I20260810 21:08:33.917654 11330 tablet_service.cc:1514] Processing DeleteTablet for tablet 5245247a782446ffb1c910a256027ee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:33 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:58750
I20260810 21:08:33.917716 11114 tablet_service.cc:1514] Processing DeleteTablet for tablet 5245247a782446ffb1c910a256027ee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:33 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:55292
I20260810 21:08:33.917711 10908 tablet_service.cc:1514] Processing DeleteTablet for tablet 5245247a782446ffb1c910a256027ee9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:33 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:36294
I20260810 21:08:33.918044 11497 tablet_replica.cc:330] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d: stopping tablet replica
I20260810 21:08:33.918138 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 10801
I20260810 21:08:33.921394 11497 raft_consensus.cc:2229] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:08:33.921622 11497 raft_consensus.cc:2258] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:08:33.922178 11497 ts_tablet_manager.cc:1905] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:08:33.924170 11497 ts_tablet_manager.cc:1918] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:08:33.924319 11497 log.cc:1196] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/5245247a782446ffb1c910a256027ee9
I20260810 21:08:33.924681 11497 ts_tablet_manager.cc:1939] T 5245247a782446ffb1c910a256027ee9 P 9e2d0ca8cb364212b6c6b772ec10715d: Deleting consensus metadata
I20260810 21:08:33.925230 10670 catalog_manager.cc:4841] TS 9e2d0ca8cb364212b6c6b772ec10715d (127.15.37.2:33721): tablet 5245247a782446ffb1c910a256027ee9 (table test-table [id=44a676e376d440459330efa503f0a824]) successfully deleted
I20260810 21:08:33.926208 11496 tablet_replica.cc:330] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926: stopping tablet replica
I20260810 21:08:33.926358 11496 raft_consensus.cc:2229] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:08:33.926504 11496 raft_consensus.cc:2258] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:08:33.930802 11496 ts_tablet_manager.cc:1905] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:08:33.932797 11496 ts_tablet_manager.cc:1918] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:08:33.932897 11496 log.cc:1196] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/5245247a782446ffb1c910a256027ee9
I20260810 21:08:33.933261 11496 ts_tablet_manager.cc:1939] T 5245247a782446ffb1c910a256027ee9 P e214cd8c55224efba9df698e72e35926: Deleting consensus metadata
I20260810 21:08:33.933806 10677 catalog_manager.cc:4841] TS e214cd8c55224efba9df698e72e35926 (127.15.37.3:35723): tablet 5245247a782446ffb1c910a256027ee9 (table test-table [id=44a676e376d440459330efa503f0a824]) successfully deleted
W20260810 21:08:33.935319 10677 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:43419 (error 108)
I20260810 21:08:33.935461 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 11013
I20260810 21:08:33.938495 11444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:33.935786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:43419 (local address 127.0.0.1:36306)
0810 21:08:33.938383 (+ 2597us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:33.938445 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:43419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2567}
W20260810 21:08:33.938864 10677 catalog_manager.cc:4584] TS c9836a90be88423b89639a1ccd16e7da (127.15.37.1:43419): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5245247a782446ffb1c910a256027ee9: Network error: Client connection negotiation failed: client connection to 127.15.37.1:43419: connect: Connection refused (error 111)
I20260810 21:08:33.949134 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 11226
I20260810 21:08:33.971442 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 10650
2026-08-10T21:08:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2457 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-10T21:08:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:34Z Disabled control of system clock
I20260810 21:08:34.011006 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:42377
--webserver_interface=127.15.37.62
--webserver_port=0
--builtin_ntp_servers=127.15.37.20:39771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:42377
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 21:08:34.098580 11506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:34.098896 11506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:34.098920 11506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:34.100150 11506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:34.100205 11506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:34.100217 11506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:34.100230 11506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:34.100242 11506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:34.102363 11506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:39771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:42377
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:42377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:34.102685 11506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:34.103015 11506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:34.108390 11518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:34.108395 11515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:34.108448 11506 server_base.cc:1034] running on GCE node
W20260810 21:08:34.108395 11514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:34.109098 11506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:34.109458 11506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:34.110642 11506 hybrid_clock.cc:648] HybridClock initialized: now 1786396114110613 us; error 40 us; skew 500 ppm
I20260810 21:08:34.112118 11506 webserver.cc:460] Webserver started at http://127.15.37.62:35857/ using document root <none> and password file <none>
I20260810 21:08:34.112426 11506 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:34.112527 11506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:34.112744 11506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:34.113919 11506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "23e324513b9f4566b3cfb970cd28f17e"
format_stamp: "Formatted at 2026-08-10 21:08:34 on dist-test-slave-jq4t"
server_key: "35f62a94e2638313b4a2473f68b9c86a"
server_key_iv: "20d0e7a756f6b2e9e7f5cacdd524f74a"
server_key_version: "encryptionkey@0"
I20260810 21:08:34.114310 11506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "23e324513b9f4566b3cfb970cd28f17e"
format_stamp: "Formatted at 2026-08-10 21:08:34 on dist-test-slave-jq4t"
server_key: "35f62a94e2638313b4a2473f68b9c86a"
server_key_iv: "20d0e7a756f6b2e9e7f5cacdd524f74a"
server_key_version: "encryptionkey@0"
I20260810 21:08:34.115760 11506 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 21:08:34.116652 11525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:34.116866 11506 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:34.116983 11506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "23e324513b9f4566b3cfb970cd28f17e"
format_stamp: "Formatted at 2026-08-10 21:08:34 on dist-test-slave-jq4t"
server_key: "35f62a94e2638313b4a2473f68b9c86a"
server_key_iv: "20d0e7a756f6b2e9e7f5cacdd524f74a"
server_key_version: "encryptionkey@0"
I20260810 21:08:34.117069 11506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:34.150019 11506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:34.150445 11506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:34.150620 11506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:34.155086 11506 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:42377
I20260810 21:08:34.155189 11604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:42377 every 8 connection(s)
I20260810 21:08:34.155556 11506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:34.156797 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 11506
I20260810 21:08:34.156944 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:34.156941 11605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:34.157164 15508 external_mini_cluster.cc:1428] Setting key 1fdc00bec849a9399e886d154293e240
I20260810 21:08:34.160670 11605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e: Bootstrap starting.
I20260810 21:08:34.161481 11605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:34.161806 11605 log.cc:824] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:34.162597 11605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e: No bootstrap required, opened a new log
I20260810 21:08:34.163535 11610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.157816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59276 (local address 127.15.37.62:42377)
0810 21:08:34.158074 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:34.158082 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:34.158110 (+ 28us) server_negotiation.cc:407] Connection header received
0810 21:08:34.158625 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:34.158633 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:34.158702 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:34.158830 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:34.159225 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.160160 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.161357 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.161862 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.162041 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.162855 (+ 814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:34.162859 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:34.162860 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:34.163037 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:34.163071 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:34.163104 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:34.163186 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:34.163263 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 21:08:34.163357 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":141,"threads_started":1}
I20260810 21:08:34.164839 11605 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23e324513b9f4566b3cfb970cd28f17e" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42377 } }
I20260810 21:08:34.165016 11605 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:34.165067 11605 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e324513b9f4566b3cfb970cd28f17e, State: Initialized, Role: FOLLOWER
I20260810 21:08:34.165217 11605 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23e324513b9f4566b3cfb970cd28f17e" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42377 } }
I20260810 21:08:34.165316 11605 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:34.165362 11605 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:34.165418 11605 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:34.165979 11605 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23e324513b9f4566b3cfb970cd28f17e" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42377 } }
I20260810 21:08:34.166069 11605 leader_election.cc:302] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23e324513b9f4566b3cfb970cd28f17e; no voters:
I20260810 21:08:34.166213 11605 leader_election.cc:288] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:34.166285 11612 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:34.166465 11612 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [term 1 LEADER]: Becoming Leader. State: Replica: 23e324513b9f4566b3cfb970cd28f17e, State: Running, Role: LEADER
I20260810 21:08:34.166527 11605 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:34.166601 11612 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23e324513b9f4566b3cfb970cd28f17e" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42377 } }
I20260810 21:08:34.167081 11616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23e324513b9f4566b3cfb970cd28f17e. Latest consensus state: current_term: 1 leader_uuid: "23e324513b9f4566b3cfb970cd28f17e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23e324513b9f4566b3cfb970cd28f17e" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42377 } } }
I20260810 21:08:34.167088 11613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23e324513b9f4566b3cfb970cd28f17e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23e324513b9f4566b3cfb970cd28f17e" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 42377 } } }
I20260810 21:08:34.167218 11616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:34.167258 11613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:34.167455 11627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:34.168020 11627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:34.169713 11627 catalog_manager.cc:1347] Generated new cluster ID: 044dcdc6d62f43c59dcd8c34db269572
I20260810 21:08:34.169767 11627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:08:34.186421 11627 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:34.187026 11627 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:34.194480 11627 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e: Generated new TSK 0
I20260810 21:08:34.194749 11627 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:34.201689 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42377
--builtin_ntp_servers=127.15.37.20:39771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 21:08:34.290055 11642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:34.290272 11642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:34.290297 11642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:34.291508 11642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:34.291551 11642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:34.291576 11642 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:08:34.293013 11642 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:39771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:34.293277 11642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:34.293612 11642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:34.298949 11652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:34.299093 11655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:34.298972 11653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:34.299338 11642 server_base.cc:1034] running on GCE node
I20260810 21:08:34.299546 11642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:34.299757 11642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:34.300925 11642 hybrid_clock.cc:648] HybridClock initialized: now 1786396114300907 us; error 37 us; skew 500 ppm
I20260810 21:08:34.302268 11642 webserver.cc:460] Webserver started at http://127.15.37.1:35379/ using document root <none> and password file <none>
I20260810 21:08:34.302528 11642 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:34.302592 11642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:34.302691 11642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:34.303752 11642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "6d213132d9734f41926696280e04500d"
format_stamp: "Formatted at 2026-08-10 21:08:34 on dist-test-slave-jq4t"
server_key: "19ae0b66a9647a44bafc1b0def039181"
server_key_iv: "15d2e8e9f6dfa428c5c9b319045a96d6"
server_key_version: "encryptionkey@0"
I20260810 21:08:34.304100 11642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "6d213132d9734f41926696280e04500d"
format_stamp: "Formatted at 2026-08-10 21:08:34 on dist-test-slave-jq4t"
server_key: "19ae0b66a9647a44bafc1b0def039181"
server_key_iv: "15d2e8e9f6dfa428c5c9b319045a96d6"
server_key_version: "encryptionkey@0"
I20260810 21:08:34.305516 11642 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:08:34.306281 11664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:34.306474 11642 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:08:34.306550 11642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "6d213132d9734f41926696280e04500d"
format_stamp: "Formatted at 2026-08-10 21:08:34 on dist-test-slave-jq4t"
server_key: "19ae0b66a9647a44bafc1b0def039181"
server_key_iv: "15d2e8e9f6dfa428c5c9b319045a96d6"
server_key_version: "encryptionkey@0"
I20260810 21:08:34.306605 11642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:34.341976 11642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:34.342330 11642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:34.342449 11642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:34.342666 11642 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:34.343062 11642 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:34.343103 11642 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:34.343127 11642 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:34.343139 11642 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:34.349885 11642 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:41123
I20260810 21:08:34.349928 11855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:41123 every 8 connection(s)
I20260810 21:08:34.350311 11642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:08:34.355969 11610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.351147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:56207 (local address 127.15.37.62:42377)
0810 21:08:34.351226 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:34.351229 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:34.351533 (+ 304us) server_negotiation.cc:407] Connection header received
0810 21:08:34.352059 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:34.352060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:34.352077 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:34.352135 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:34.352932 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.353447 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.354545 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.354750 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.354819 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.355693 (+ 874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:34.355694 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:34.355694 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:34.355699 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:34.355714 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:34.355718 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:34.355763 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:34.355851 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 21:08:34.355900 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 21:08:34.356158 11859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.351138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42377 (local address 127.15.37.1:56207)
0810 21:08:34.351400 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:34.351438 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:34.351957 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:34.352189 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:34.352192 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:34.352200 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:34.352846 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:34.352853 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.353565 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.353566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:34.354434 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:34.354436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.354843 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.354844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:34.354966 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.355548 (+ 582us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:08:34.355548 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:34.355580 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:08:34.355605 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:34.355775 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:34.355779 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:34.355782 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:08:34.355835 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 21:08:34.355928 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":122,"threads_started":1}
I20260810 21:08:34.356765 11856 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42377
I20260810 21:08:34.356920 11856 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:34.357161 11856 heartbeater.cc:511] Master 127.15.37.62:42377 requested a full tablet report, sending...
I20260810 21:08:34.357738 11552 ts_manager.cc:194] Registered new tserver with Master: 6d213132d9734f41926696280e04500d (127.15.37.1:41123)
I20260810 21:08:34.358435 11552 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.37.1:56207
I20260810 21:08:34.359156 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 11642
I20260810 21:08:34.359243 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:08:34.359464 15508 external_mini_cluster.cc:1428] Setting key 3384214c834e506e90d63127c529bbab
I20260810 21:08:34.360589 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42377
--builtin_ntp_servers=127.15.37.20:39771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 21:08:34.450526 11861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:34.450839 11861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:34.450886 11861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:34.452207 11861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:34.452286 11861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:34.452333 11861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:08:34.453943 11861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:39771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:34.454277 11861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:34.454641 11861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:34.460187 11870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:34.460187 11871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:34.460211 11876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:34.460461 11861 server_base.cc:1034] running on GCE node
I20260810 21:08:34.460713 11861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:34.461004 11861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:34.462172 11861 hybrid_clock.cc:648] HybridClock initialized: now 1786396114462147 us; error 39 us; skew 500 ppm
I20260810 21:08:34.463766 11861 webserver.cc:460] Webserver started at http://127.15.37.2:33023/ using document root <none> and password file <none>
I20260810 21:08:34.464074 11861 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:34.464129 11861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:34.464315 11861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:34.465523 11861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "5637e908b0914186911ef6d7e5b10a29"
format_stamp: "Formatted at 2026-08-10 21:08:34 on dist-test-slave-jq4t"
server_key: "56775e44cf4d07fa7a1dbc85de096f89"
server_key_iv: "1fe9968485c7944b8005ada76e6ba923"
server_key_version: "encryptionkey@0"
I20260810 21:08:34.465942 11861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "5637e908b0914186911ef6d7e5b10a29"
format_stamp: "Formatted at 2026-08-10 21:08:34 on dist-test-slave-jq4t"
server_key: "56775e44cf4d07fa7a1dbc85de096f89"
server_key_iv: "1fe9968485c7944b8005ada76e6ba923"
server_key_version: "encryptionkey@0"
I20260810 21:08:34.467465 11861 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 21:08:34.468336 11882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:34.468555 11861 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:34.468662 11861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "5637e908b0914186911ef6d7e5b10a29"
format_stamp: "Formatted at 2026-08-10 21:08:34 on dist-test-slave-jq4t"
server_key: "56775e44cf4d07fa7a1dbc85de096f89"
server_key_iv: "1fe9968485c7944b8005ada76e6ba923"
server_key_version: "encryptionkey@0"
I20260810 21:08:34.468746 11861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:34.489703 11861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:34.490115 11861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:34.490288 11861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:34.490556 11861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:34.490955 11861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:34.491015 11861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:34.491065 11861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:34.491098 11861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:34.497874 11861 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:37965
I20260810 21:08:34.497920 12063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:37965 every 8 connection(s)
I20260810 21:08:34.498298 11861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:08:34.504141 11610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.499127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:55043 (local address 127.15.37.62:42377)
0810 21:08:34.499195 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:34.499197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:34.499476 (+ 279us) server_negotiation.cc:407] Connection header received
0810 21:08:34.499975 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:34.499976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:34.499988 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:34.500059 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:34.500965 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.501493 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.502598 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.502804 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.502872 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.503805 (+ 933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:34.503807 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:34.503807 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:34.503814 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:34.503832 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:34.503836 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:34.503893 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:34.504040 (+ 147us) server_negotiation.cc:299] Negotiation successful
0810 21:08:34.504071 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 21:08:34.504441 12067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.499090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42377 (local address 127.15.37.2:55043)
0810 21:08:34.499298 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:34.499345 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:34.499874 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:34.500170 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:34.500174 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:34.500185 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:34.500843 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:34.500850 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.501606 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.501607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:34.502472 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:34.502474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.502902 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.502903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:34.503031 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.503640 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:08:34.503640 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:34.503673 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:08:34.503701 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:34.503929 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:34.503936 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:34.503939 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:08:34.504025 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 21:08:34.504139 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":102,"threads_started":1}
I20260810 21:08:34.505163 12064 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42377
I20260810 21:08:34.505292 12064 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:34.505514 12064 heartbeater.cc:511] Master 127.15.37.62:42377 requested a full tablet report, sending...
I20260810 21:08:34.505950 11552 ts_manager.cc:194] Registered new tserver with Master: 5637e908b0914186911ef6d7e5b10a29 (127.15.37.2:37965)
I20260810 21:08:34.506356 11552 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.37.2:55043
I20260810 21:08:34.506871 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 11861
I20260810 21:08:34.506968 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:08:34.507186 15508 external_mini_cluster.cc:1428] Setting key 7c5d746ee5672dd0503796aff42345a3
I20260810 21:08:34.508232 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42377
--builtin_ntp_servers=127.15.37.20:39771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 21:08:34.596094 12069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:34.596573 12069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:34.596633 12069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:34.597954 12069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:34.598030 12069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:34.598074 12069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:08:34.599517 12069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:39771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:42377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:34.599836 12069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:34.600195 12069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:34.605772 12082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:34.605755 12075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:34.605816 12069 server_base.cc:1034] running on GCE node
W20260810 21:08:34.605762 12078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:34.606252 12069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:34.606546 12069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:34.607730 12069 hybrid_clock.cc:648] HybridClock initialized: now 1786396114607713 us; error 29 us; skew 500 ppm
I20260810 21:08:34.609336 12069 webserver.cc:460] Webserver started at http://127.15.37.3:46325/ using document root <none> and password file <none>
I20260810 21:08:34.609601 12069 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:34.609678 12069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:34.609844 12069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:34.611060 12069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "0212b85ee8d3465a9e002ba596d64d63"
format_stamp: "Formatted at 2026-08-10 21:08:34 on dist-test-slave-jq4t"
server_key: "8327c2e800abac1d911e845103a59fe9"
server_key_iv: "74f92a4128fd3c29acb8abf4f066da9e"
server_key_version: "encryptionkey@0"
I20260810 21:08:34.611447 12069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "0212b85ee8d3465a9e002ba596d64d63"
format_stamp: "Formatted at 2026-08-10 21:08:34 on dist-test-slave-jq4t"
server_key: "8327c2e800abac1d911e845103a59fe9"
server_key_iv: "74f92a4128fd3c29acb8abf4f066da9e"
server_key_version: "encryptionkey@0"
I20260810 21:08:34.612895 12069 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260810 21:08:34.613692 12093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:34.613894 12069 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:34.614008 12069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "0212b85ee8d3465a9e002ba596d64d63"
format_stamp: "Formatted at 2026-08-10 21:08:34 on dist-test-slave-jq4t"
server_key: "8327c2e800abac1d911e845103a59fe9"
server_key_iv: "74f92a4128fd3c29acb8abf4f066da9e"
server_key_version: "encryptionkey@0"
I20260810 21:08:34.614089 12069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:34.639787 12069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:34.640193 12069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:34.640367 12069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:34.640738 12069 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:34.641168 12069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:34.641232 12069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:34.641279 12069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:34.641306 12069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:34.647817 12069 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:39785
I20260810 21:08:34.647877 12260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:39785 every 8 connection(s)
I20260810 21:08:34.648298 12069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:08:34.653914 11610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.649229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:49179 (local address 127.15.37.62:42377)
0810 21:08:34.649280 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:34.649282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:34.649526 (+ 244us) server_negotiation.cc:407] Connection header received
0810 21:08:34.650064 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:34.650065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:34.650076 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:34.650132 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:34.650832 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.651346 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.652380 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.652592 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.652644 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.653636 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:34.653637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:34.653637 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:34.653642 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:34.653660 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:34.653664 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:34.653721 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:34.653795 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 21:08:34.653844 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 21:08:34.654109 12265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.649194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:42377 (local address 127.15.37.3:49179)
0810 21:08:34.649394 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:34.649430 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:34.649959 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:34.650185 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:34.650188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:34.650196 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:34.650728 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:34.650732 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.651434 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.651435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:34.652296 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:34.652298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.652667 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.652668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:34.652787 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.653471 (+ 684us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:08:34.653472 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:34.653503 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:08:34.653530 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:34.653724 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:34.653727 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:34.653729 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 21:08:34.653776 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 21:08:34.653871 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":103,"threads_started":1}
I20260810 21:08:34.654695 12261 heartbeater.cc:347] Connected to a master server at 127.15.37.62:42377
I20260810 21:08:34.654791 12261 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:34.655004 12261 heartbeater.cc:511] Master 127.15.37.62:42377 requested a full tablet report, sending...
I20260810 21:08:34.655027 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 12069
I20260810 21:08:34.655185 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:08:34.655435 15508 external_mini_cluster.cc:1428] Setting key a90de8c22a818637bb34ae7b298fb5c3
I20260810 21:08:34.655503 11552 ts_manager.cc:194] Registered new tserver with Master: 0212b85ee8d3465a9e002ba596d64d63 (127.15.37.3:39785)
I20260810 21:08:34.655997 11552 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.37.3:49179
I20260810 21:08:34.656646 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:08:34.661857 11610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.658136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59290 (local address 127.15.37.62:42377)
0810 21:08:34.658219 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:34.658221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:34.658318 (+ 97us) server_negotiation.cc:407] Connection header received
0810 21:08:34.658399 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:34.658400 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:34.658411 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:34.658462 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:34.658646 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.659167 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.660521 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.660734 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.660809 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.661607 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:34.661608 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:34.661608 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:34.661613 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:34.661629 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:34.661633 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:34.661681 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:34.661738 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 21:08:34.661763 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260810 21:08:34.663725 11552 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59290:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:08:34.665540 11552 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:08:34.673169 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.667998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:39785 (local address 127.0.0.1:48072)
0810 21:08:34.668358 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:34.668401 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:34.668500 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:34.669169 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:34.669170 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:34.669171 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:34.669213 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:34.669214 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.670548 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.670549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:34.671729 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:34.671731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.672844 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.672845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:34.672930 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.672944 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 21:08:34.673013 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 21:08:34.673070 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":69,"threads_started":1}
I20260810 21:08:34.673213 12277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.668125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36934 (local address 127.15.37.1:41123)
0810 21:08:34.668336 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:34.668348 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:34.668895 (+ 547us) server_negotiation.cc:407] Connection header received
0810 21:08:34.668963 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:34.668965 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:34.668983 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:34.669065 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:34.669262 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.670162 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.671708 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.672594 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.672693 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.672802 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:34.673079 (+ 277us) server_negotiation.cc:299] Negotiation successful
0810 21:08:34.673120 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":100,"threads_started":1}
I20260810 21:08:34.673367 12280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.668372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59324 (local address 127.15.37.2:37965)
0810 21:08:34.668617 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:34.668622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:34.669370 (+ 748us) server_negotiation.cc:407] Connection header received
0810 21:08:34.669424 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:34.669427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:34.669443 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:34.669529 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:34.669660 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.670871 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.672020 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.672819 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.672897 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.672986 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:34.673216 (+ 230us) server_negotiation.cc:299] Negotiation successful
0810 21:08:34.673263 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":107,"threads_started":1}
I20260810 21:08:34.673796 12281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.668405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48072 (local address 127.15.37.3:39785)
0810 21:08:34.669012 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:34.669016 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:34.669026 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:08:34.669066 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:34.669067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:34.669081 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:34.669158 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:34.669300 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.670459 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.671828 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.672626 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.672703 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.672802 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:34.673678 (+ 876us) server_negotiation.cc:299] Negotiation successful
0810 21:08:34.673723 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":126,"threads_started":1}
I20260810 21:08:34.673499 12278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.668003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:41123 (local address 127.0.0.1:36934)
0810 21:08:34.668811 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:34.668821 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:34.668880 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:34.669079 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:34.669082 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:34.669085 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:34.669170 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:34.669172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.670260 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.670261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:34.671569 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:34.671572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.672862 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.672863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:34.672961 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.672966 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:08:34.673369 (+ 403us) client_negotiation.cc:240] Negotiation successful
0810 21:08:34.673418 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"thread_start_us":75,"threads_started":1}
I20260810 21:08:34.674137 12276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:34.668240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:37965 (local address 127.0.0.1:59324)
0810 21:08:34.669266 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:34.669278 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:34.669346 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:34.669539 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:34.669541 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:34.669543 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:34.669594 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:34.669595 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.670961 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.670962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:34.671928 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:34.671932 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:34.673021 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:34.673022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:34.673074 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:34.673077 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:08:34.673123 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 21:08:34.673158 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1013,"thread_start_us":71,"threads_started":1}
I20260810 21:08:34.674615 12168 tablet_service.cc:1467] Processing CreateTablet for tablet 82cd59d0f0594a1b8a209f65fd06557f (DEFAULT_TABLE table=test-table [id=6d01915ef76c4801af0341d347fa91b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:34.674633 11733 tablet_service.cc:1467] Processing CreateTablet for tablet 82cd59d0f0594a1b8a209f65fd06557f (DEFAULT_TABLE table=test-table [id=6d01915ef76c4801af0341d347fa91b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:34.674991 11733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82cd59d0f0594a1b8a209f65fd06557f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:34.674996 12168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82cd59d0f0594a1b8a209f65fd06557f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:34.677860 12282 tablet_bootstrap.cc:492] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d: Bootstrap starting.
I20260810 21:08:34.677865 12283 tablet_bootstrap.cc:492] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63: Bootstrap starting.
I20260810 21:08:34.678552 12282 tablet_bootstrap.cc:654] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:34.678594 12283 tablet_bootstrap.cc:654] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:34.678656 11960 tablet_service.cc:1467] Processing CreateTablet for tablet 82cd59d0f0594a1b8a209f65fd06557f (DEFAULT_TABLE table=test-table [id=6d01915ef76c4801af0341d347fa91b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:34.678920 12283 log.cc:824] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:34.678930 12282 log.cc:824] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:34.679052 11960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82cd59d0f0594a1b8a209f65fd06557f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:34.679663 12282 tablet_bootstrap.cc:492] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d: No bootstrap required, opened a new log
I20260810 21:08:34.679740 12282 ts_tablet_manager.cc:1397] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:08:34.681732 12282 raft_consensus.cc:348] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d213132d9734f41926696280e04500d" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 41123 } } peers { permanent_uuid: "0212b85ee8d3465a9e002ba596d64d63" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39785 } } peers { permanent_uuid: "5637e908b0914186911ef6d7e5b10a29" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37965 } }
I20260810 21:08:34.681949 12282 raft_consensus.cc:374] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:34.682005 12282 raft_consensus.cc:729] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d213132d9734f41926696280e04500d, State: Initialized, Role: FOLLOWER
I20260810 21:08:34.681932 12286 tablet_bootstrap.cc:492] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29: Bootstrap starting.
I20260810 21:08:34.682133 12282 consensus_queue.cc:260] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d213132d9734f41926696280e04500d" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 41123 } } peers { permanent_uuid: "0212b85ee8d3465a9e002ba596d64d63" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39785 } } peers { permanent_uuid: "5637e908b0914186911ef6d7e5b10a29" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37965 } }
I20260810 21:08:34.682426 12282 ts_tablet_manager.cc:1428] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:08:34.682559 11856 heartbeater.cc:503] Master 127.15.37.62:42377 was elected leader, sending a full tablet report...
I20260810 21:08:34.682639 12283 tablet_bootstrap.cc:492] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63: No bootstrap required, opened a new log
I20260810 21:08:34.682714 12283 ts_tablet_manager.cc:1397] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260810 21:08:34.682766 12286 tablet_bootstrap.cc:654] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:34.683082 12286 log.cc:824] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:34.683899 12286 tablet_bootstrap.cc:492] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29: No bootstrap required, opened a new log
I20260810 21:08:34.683975 12286 ts_tablet_manager.cc:1397] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:08:34.685169 12283 raft_consensus.cc:348] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d213132d9734f41926696280e04500d" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 41123 } } peers { permanent_uuid: "0212b85ee8d3465a9e002ba596d64d63" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39785 } } peers { permanent_uuid: "5637e908b0914186911ef6d7e5b10a29" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37965 } }
I20260810 21:08:34.685319 12283 raft_consensus.cc:374] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:34.685369 12283 raft_consensus.cc:729] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0212b85ee8d3465a9e002ba596d64d63, State: Initialized, Role: FOLLOWER
I20260810 21:08:34.685489 12283 consensus_queue.cc:260] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d213132d9734f41926696280e04500d" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 41123 } } peers { permanent_uuid: "0212b85ee8d3465a9e002ba596d64d63" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39785 } } peers { permanent_uuid: "5637e908b0914186911ef6d7e5b10a29" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37965 } }
I20260810 21:08:34.685750 12283 ts_tablet_manager.cc:1428] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:08:34.685820 12261 heartbeater.cc:503] Master 127.15.37.62:42377 was elected leader, sending a full tablet report...
I20260810 21:08:34.686268 12286 raft_consensus.cc:348] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d213132d9734f41926696280e04500d" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 41123 } } peers { permanent_uuid: "0212b85ee8d3465a9e002ba596d64d63" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39785 } } peers { permanent_uuid: "5637e908b0914186911ef6d7e5b10a29" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37965 } }
I20260810 21:08:34.686439 12286 raft_consensus.cc:374] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:34.686496 12286 raft_consensus.cc:729] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5637e908b0914186911ef6d7e5b10a29, State: Initialized, Role: FOLLOWER
I20260810 21:08:34.686620 12286 consensus_queue.cc:260] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d213132d9734f41926696280e04500d" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 41123 } } peers { permanent_uuid: "0212b85ee8d3465a9e002ba596d64d63" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39785 } } peers { permanent_uuid: "5637e908b0914186911ef6d7e5b10a29" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37965 } }
I20260810 21:08:34.686904 12286 ts_tablet_manager.cc:1428] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:08:34.686964 12064 heartbeater.cc:503] Master 127.15.37.62:42377 was elected leader, sending a full tablet report...
W20260810 21:08:34.748934 12065 tablet.cc:2369] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:08:34.851161 11857 tablet.cc:2369] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:08:34.899032 12263 tablet.cc:2369] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:08:35.034472 12288 raft_consensus.cc:482] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:08:35.034633 12288 raft_consensus.cc:504] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d213132d9734f41926696280e04500d" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 41123 } } peers { permanent_uuid: "0212b85ee8d3465a9e002ba596d64d63" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39785 } } peers { permanent_uuid: "5637e908b0914186911ef6d7e5b10a29" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37965 } }
I20260810 21:08:35.035145 12288 leader_election.cc:288] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0212b85ee8d3465a9e002ba596d64d63 (127.15.37.3:39785), 5637e908b0914186911ef6d7e5b10a29 (127.15.37.2:37965)
I20260810 21:08:35.038472 12280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:35.035668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:46433 (local address 127.15.37.2:37965)
0810 21:08:35.035733 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:35.035735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:35.035764 (+ 29us) server_negotiation.cc:407] Connection header received
0810 21:08:35.035873 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:35.035874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:35.035900 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:35.035963 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:35.036151 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:35.036684 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:35.037705 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:35.038075 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:35.038163 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:35.038174 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:35.038343 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 21:08:35.038383 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 21:08:35.038527 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:35.035345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:39785 (local address 127.15.37.1:38591)
0810 21:08:35.035497 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:35.035511 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:35.035631 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:35.035870 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:35.035871 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:35.035874 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:35.035970 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:35.035972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:35.036731 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:35.036732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:35.037605 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:35.037608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:35.038202 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:35.038204 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:35.038296 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:35.038299 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:08:35.038370 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 21:08:35.038415 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":5,"thread_start_us":88,"threads_started":1}
I20260810 21:08:35.038504 12281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:35.035461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:38591 (local address 127.15.37.3:39785)
0810 21:08:35.035551 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:35.035554 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:35.035627 (+ 73us) server_negotiation.cc:407] Connection header received
0810 21:08:35.035757 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:35.035758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:35.035778 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:35.035859 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:35.036050 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:35.036636 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:35.037713 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:35.038107 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:35.038196 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:35.038207 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:35.038377 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 21:08:35.038427 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 21:08:35.038543 12295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:35.035567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:37965 (local address 127.15.37.1:46433)
0810 21:08:35.035695 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:35.035708 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:35.035779 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:35.035983 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:35.035984 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:35.035986 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:35.036068 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:35.036070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:35.036771 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:35.036772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:35.037596 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:35.037598 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:35.038165 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:35.038167 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:35.038251 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:35.038255 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:08:35.038332 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 21:08:35.038380 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":75,"threads_started":1}
I20260810 21:08:35.038921 12001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82cd59d0f0594a1b8a209f65fd06557f" candidate_uuid: "6d213132d9734f41926696280e04500d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5637e908b0914186911ef6d7e5b10a29" is_pre_election: true
I20260810 21:08:35.038971 12196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82cd59d0f0594a1b8a209f65fd06557f" candidate_uuid: "6d213132d9734f41926696280e04500d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212b85ee8d3465a9e002ba596d64d63" is_pre_election: true
I20260810 21:08:35.039127 12001 raft_consensus.cc:2454] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d213132d9734f41926696280e04500d in term 0.
I20260810 21:08:35.039139 12196 raft_consensus.cc:2454] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d213132d9734f41926696280e04500d in term 0.
I20260810 21:08:35.039394 11668 leader_election.cc:302] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5637e908b0914186911ef6d7e5b10a29, 6d213132d9734f41926696280e04500d; no voters:
I20260810 21:08:35.039570 12288 raft_consensus.cc:2781] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:08:35.039649 12288 raft_consensus.cc:482] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:08:35.039667 12288 raft_consensus.cc:3037] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:35.040608 12288 raft_consensus.cc:504] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d213132d9734f41926696280e04500d" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 41123 } } peers { permanent_uuid: "0212b85ee8d3465a9e002ba596d64d63" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39785 } } peers { permanent_uuid: "5637e908b0914186911ef6d7e5b10a29" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37965 } }
I20260810 21:08:35.040766 12288 leader_election.cc:288] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [CANDIDATE]: Term 1 election: Requested vote from peers 0212b85ee8d3465a9e002ba596d64d63 (127.15.37.3:39785), 5637e908b0914186911ef6d7e5b10a29 (127.15.37.2:37965)
I20260810 21:08:35.041024 12001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82cd59d0f0594a1b8a209f65fd06557f" candidate_uuid: "6d213132d9734f41926696280e04500d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5637e908b0914186911ef6d7e5b10a29"
I20260810 21:08:35.041028 12196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82cd59d0f0594a1b8a209f65fd06557f" candidate_uuid: "6d213132d9734f41926696280e04500d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0212b85ee8d3465a9e002ba596d64d63"
I20260810 21:08:35.041100 12001 raft_consensus.cc:3037] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:35.041142 12196 raft_consensus.cc:3037] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:35.041934 12001 raft_consensus.cc:2454] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d213132d9734f41926696280e04500d in term 1.
I20260810 21:08:35.041940 12196 raft_consensus.cc:2454] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d213132d9734f41926696280e04500d in term 1.
I20260810 21:08:35.042150 11668 leader_election.cc:302] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5637e908b0914186911ef6d7e5b10a29, 6d213132d9734f41926696280e04500d; no voters:
I20260810 21:08:35.042287 12288 raft_consensus.cc:2781] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:35.042488 12288 raft_consensus.cc:686] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [term 1 LEADER]: Becoming Leader. State: Replica: 6d213132d9734f41926696280e04500d, State: Running, Role: LEADER
I20260810 21:08:35.042623 12288 consensus_queue.cc:237] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d213132d9734f41926696280e04500d" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 41123 } } peers { permanent_uuid: "0212b85ee8d3465a9e002ba596d64d63" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39785 } } peers { permanent_uuid: "5637e908b0914186911ef6d7e5b10a29" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37965 } }
I20260810 21:08:35.043728 11552 catalog_manager.cc:5495] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d213132d9734f41926696280e04500d (127.15.37.1). New cstate: current_term: 1 leader_uuid: "6d213132d9734f41926696280e04500d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d213132d9734f41926696280e04500d" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 41123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0212b85ee8d3465a9e002ba596d64d63" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5637e908b0914186911ef6d7e5b10a29" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37965 } health_report { overall_health: UNKNOWN } } }
I20260810 21:08:35.116137 12277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:35.113727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36942 (local address 127.15.37.1:41123)
0810 21:08:35.113804 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:35.113806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:35.113815 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:08:35.113865 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:35.113866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:35.113892 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:35.113969 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:08:35.114122 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:35.114621 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:35.115416 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:35.115616 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:35.115675 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:35.115816 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:08:35.115940 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:08:35.116008 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:35.116046 (+ 38us) server_negotiation.cc:299] Negotiation successful
0810 21:08:35.116069 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 21:08:35.118438 12001 raft_consensus.cc:1261] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29 [term 1 FOLLOWER]: Refusing update from remote peer 6d213132d9734f41926696280e04500d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:08:35.118438 12196 raft_consensus.cc:1261] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63 [term 1 FOLLOWER]: Refusing update from remote peer 6d213132d9734f41926696280e04500d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:08:35.118847 12296 consensus_queue.cc:1035] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0212b85ee8d3465a9e002ba596d64d63" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:08:35.118989 12288 consensus_queue.cc:1035] T 82cd59d0f0594a1b8a209f65fd06557f P 6d213132d9734f41926696280e04500d [LEADER]: Connected to new peer: Peer: permanent_uuid: "5637e908b0914186911ef6d7e5b10a29" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:08:35.122210 12300 mvcc.cc:205] Tried to move back new op lower bound from 7317078487521841152 to 7317078487215452160. Current Snapshot: MvccSnapshot[applied={T|T < 7317078487521841152}]
I20260810 21:08:35.122587 12304 mvcc.cc:205] Tried to move back new op lower bound from 7317078487521841152 to 7317078487215452160. Current Snapshot: MvccSnapshot[applied={T|T < 7317078487521841152}]
I20260810 21:08:35.122800 12307 mvcc.cc:205] Tried to move back new op lower bound from 7317078487521841152 to 7317078487215452160. Current Snapshot: MvccSnapshot[applied={T|T < 7317078487521841152}]
I20260810 21:08:35.125677 11552 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:08:35.125794 11552 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59290:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:08:35.126693 11552 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 23e324513b9f4566b3cfb970cd28f17e: Sending DeleteTablet for 3 replicas of tablet 82cd59d0f0594a1b8a209f65fd06557f
I20260810 21:08:35.127080 11733 tablet_service.cc:1514] Processing DeleteTablet for tablet 82cd59d0f0594a1b8a209f65fd06557f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:35 UTC) from {username='slave'} at 127.0.0.1:36934
I20260810 21:08:35.127110 12168 tablet_service.cc:1514] Processing DeleteTablet for tablet 82cd59d0f0594a1b8a209f65fd06557f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:35 UTC) from {username='slave'} at 127.0.0.1:48072
I20260810 21:08:35.127133 11960 tablet_service.cc:1514] Processing DeleteTablet for tablet 82cd59d0f0594a1b8a209f65fd06557f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:35 UTC) from {username='slave'} at 127.0.0.1:59324
I20260810 21:08:35.127367 12322 tablet_replica.cc:330] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29: stopping tablet replica
I20260810 21:08:35.127545 12322 raft_consensus.cc:2229] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:08:35.127584 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 11642
I20260810 21:08:35.127753 12322 raft_consensus.cc:2258] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:08:35.128000 12319 tablet_replica.cc:330] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63: stopping tablet replica
I20260810 21:08:35.128253 12319 raft_consensus.cc:2229] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:08:35.128419 12319 raft_consensus.cc:2258] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:08:35.129253 12322 ts_tablet_manager.cc:1905] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:08:35.131695 12322 ts_tablet_manager.cc:1918] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:08:35.131846 12322 log.cc:1196] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/82cd59d0f0594a1b8a209f65fd06557f
I20260810 21:08:35.132045 12319 ts_tablet_manager.cc:1905] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:08:35.132220 12322 ts_tablet_manager.cc:1939] T 82cd59d0f0594a1b8a209f65fd06557f P 5637e908b0914186911ef6d7e5b10a29: Deleting consensus metadata
I20260810 21:08:35.132761 11530 catalog_manager.cc:4841] TS 5637e908b0914186911ef6d7e5b10a29 (127.15.37.2:37965): tablet 82cd59d0f0594a1b8a209f65fd06557f (table test-table [id=6d01915ef76c4801af0341d347fa91b6]) successfully deleted
I20260810 21:08:35.134526 12319 ts_tablet_manager.cc:1918] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:08:35.134635 12319 log.cc:1196] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/82cd59d0f0594a1b8a209f65fd06557f
I20260810 21:08:35.135033 12319 ts_tablet_manager.cc:1939] T 82cd59d0f0594a1b8a209f65fd06557f P 0212b85ee8d3465a9e002ba596d64d63: Deleting consensus metadata
I20260810 21:08:35.136471 11530 catalog_manager.cc:4841] TS 0212b85ee8d3465a9e002ba596d64d63 (127.15.37.3:39785): tablet 82cd59d0f0594a1b8a209f65fd06557f (table test-table [id=6d01915ef76c4801af0341d347fa91b6]) successfully deleted
W20260810 21:08:35.143910 11528 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:41123 (error 108)
I20260810 21:08:35.144145 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 11861
I20260810 21:08:35.149416 12278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:35.149221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:41123 (local address 127.0.0.1:36954)
0810 21:08:35.149284 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:35.149345 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:41123: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 21:08:35.149736 11528 catalog_manager.cc:4584] TS 6d213132d9734f41926696280e04500d (127.15.37.1:41123): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 82cd59d0f0594a1b8a209f65fd06557f: Network error: Client connection negotiation failed: client connection to 127.15.37.1:41123: connect: Connection refused (error 111)
I20260810 21:08:35.166416 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 12069
I20260810 21:08:35.185932 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 11506
2026-08-10T21:08:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1217 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:35 dist-test-slave-jq4t krb5kdc[12326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:35 dist-test-slave-jq4t krb5kdc[12326](info): set up 2 sockets
Aug 10 21:08:35 dist-test-slave-jq4t krb5kdc[12326](info): commencing operation
krb5kdc: starting...
W20260810 21:08:36.465456 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:36 dist-test-slave-jq4t krb5kdc[12326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:08:36.603776 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:36489
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:38033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:36489
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:36.693967 12349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:36.694209 12349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:36.694234 12349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:36.695489 12349 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:36.695559 12349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:36.695575 12349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:36.695588 12349 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:36.695600 12349 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:36.697309 12349 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:38033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:36489
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:36489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:36.697624 12349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:36.697901 12349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:36.703255 12356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:36.703256 12357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:36.703260 12361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:36.703596 12349 server_base.cc:1034] running on GCE node
I20260810 21:08:36.703912 12349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:36.704269 12349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:36.705473 12349 hybrid_clock.cc:648] HybridClock initialized: now 1786396116705443 us; error 58 us; skew 500 ppm
Aug 10 21:08:36 dist-test-slave-jq4t krb5kdc[12326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396116, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:36.712352 12349 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:08:36.713047 12349 webserver.cc:460] Webserver started at http://127.15.37.62:43441/ using document root <none> and password file <none>
I20260810 21:08:36.713349 12349 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:36.713433 12349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:36.713603 12349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:36.714808 12349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "1f5112ef8dfc43a3bf958195da4520bf"
format_stamp: "Formatted at 2026-08-10 21:08:36 on dist-test-slave-jq4t"
server_key: "80d6a3f3d6f5a22cef623d83956579df"
server_key_iv: "381fc057415698d57b825f721789baec"
server_key_version: "encryptionkey@0"
I20260810 21:08:36.715221 12349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "1f5112ef8dfc43a3bf958195da4520bf"
format_stamp: "Formatted at 2026-08-10 21:08:36 on dist-test-slave-jq4t"
server_key: "80d6a3f3d6f5a22cef623d83956579df"
server_key_iv: "381fc057415698d57b825f721789baec"
server_key_version: "encryptionkey@0"
I20260810 21:08:36.716849 12349 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:08:36.717746 12372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:36.717953 12349 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:36.718075 12349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "1f5112ef8dfc43a3bf958195da4520bf"
format_stamp: "Formatted at 2026-08-10 21:08:36 on dist-test-slave-jq4t"
server_key: "80d6a3f3d6f5a22cef623d83956579df"
server_key_iv: "381fc057415698d57b825f721789baec"
server_key_version: "encryptionkey@0"
I20260810 21:08:36.718163 12349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:36.727902 12349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:36.730512 12349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:36.730695 12349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:36.735260 12349 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:36489
I20260810 21:08:36.735322 12458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:36489 every 8 connection(s)
I20260810 21:08:36.735724 12349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:36.736778 12459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:36.739226 12459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf: Bootstrap starting.
I20260810 21:08:36.739841 12459 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:36.740096 12459 log.cc:824] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:36.740717 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 12349
I20260810 21:08:36.740854 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:36.741024 12459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf: No bootstrap required, opened a new log
I20260810 21:08:36.741068 15508 external_mini_cluster.cc:1428] Setting key aafc89d9fcdf8806c54817a9bf4f53f5
I20260810 21:08:36.743619 12459 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5112ef8dfc43a3bf958195da4520bf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36489 } }
I20260810 21:08:36.743799 12459 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:36.743858 12459 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f5112ef8dfc43a3bf958195da4520bf, State: Initialized, Role: FOLLOWER
I20260810 21:08:36.744005 12459 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5112ef8dfc43a3bf958195da4520bf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36489 } }
I20260810 21:08:36.744107 12459 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:36.744154 12459 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:36.744204 12459 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:36.744951 12459 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5112ef8dfc43a3bf958195da4520bf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36489 } }
I20260810 21:08:36.745087 12459 leader_election.cc:302] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f5112ef8dfc43a3bf958195da4520bf; no voters:
I20260810 21:08:36.745312 12459 leader_election.cc:288] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:36.745386 12466 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:36.745604 12459 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:36.745616 12466 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [term 1 LEADER]: Becoming Leader. State: Replica: 1f5112ef8dfc43a3bf958195da4520bf, State: Running, Role: LEADER
I20260810 21:08:36.745898 12466 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5112ef8dfc43a3bf958195da4520bf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36489 } }
I20260810 21:08:36.746346 12469 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f5112ef8dfc43a3bf958195da4520bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5112ef8dfc43a3bf958195da4520bf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36489 } } }
I20260810 21:08:36.746435 12469 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:36.746686 12470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f5112ef8dfc43a3bf958195da4520bf. Latest consensus state: current_term: 1 leader_uuid: "1f5112ef8dfc43a3bf958195da4520bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f5112ef8dfc43a3bf958195da4520bf" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 36489 } } }
I20260810 21:08:36.747090 12470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:36.747332 12480 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:36.748060 12480 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:36.749954 12480 catalog_manager.cc:1347] Generated new cluster ID: 7608ba48eab74c4e80945ce46f151ca4
I20260810 21:08:36.750015 12480 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:08:36 dist-test-slave-jq4t krb5kdc[12326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:08:36.755061 12465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:36.741664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48440 (local address 127.15.37.62:36489)
0810 21:08:36.741865 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:36.741874 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:36.741902 (+ 28us) server_negotiation.cc:407] Connection header received
0810 21:08:36.742483 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:36.742492 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:36.742547 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:36.742669 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:36.743534 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:36.745014 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:36.746322 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:36.747073 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:36.747177 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:36.750601 (+ 3424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:36.750605 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:36.750606 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:36.750620 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:36.752956 (+ 2336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:36.753381 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:36.753385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:36.753385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:36.753506 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:36.753752 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:36.753753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:36.753753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:36.754018 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:36.754593 (+ 575us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:36.754671 (+ 78us) server_negotiation.cc:299] Negotiation successful
0810 21:08:36.754854 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":99,"threads_started":1}
I20260810 21:08:36.755566 12480 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:36.756448 12480 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:36.759187 12480 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf: Generated new TSK 0
I20260810 21:08:36.759364 12480 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:08:36.795428 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36489
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:38033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:36.900913 12499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:36.901137 12499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:36.901165 12499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:36.902490 12499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:36.902535 12499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:36.902565 12499 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:08:36.904145 12499 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:38033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:36.904409 12499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:36.904724 12499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:36.911764 12514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:36.911748 12511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:36.911924 12499 server_base.cc:1034] running on GCE node
W20260810 21:08:36.911717 12510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:36.912593 12499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:36.912885 12499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:36.914073 12499 hybrid_clock.cc:648] HybridClock initialized: now 1786396116914052 us; error 34 us; skew 500 ppm
Aug 10 21:08:36 dist-test-slave-jq4t krb5kdc[12326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396116, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:36.917290 12499 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:08:36.917843 12499 webserver.cc:460] Webserver started at http://127.15.37.1:33993/ using document root <none> and password file <none>
I20260810 21:08:36.918097 12499 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:36.918172 12499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:36.918327 12499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:36.919478 12499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "422b6ed677bf4b4e90400865ed8426fc"
format_stamp: "Formatted at 2026-08-10 21:08:36 on dist-test-slave-jq4t"
server_key: "9b12c80f59066b3e6ce896dd38c7f2a9"
server_key_iv: "af64acc6c194c5c8b741aab403171bc7"
server_key_version: "encryptionkey@0"
I20260810 21:08:36.919862 12499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "422b6ed677bf4b4e90400865ed8426fc"
format_stamp: "Formatted at 2026-08-10 21:08:36 on dist-test-slave-jq4t"
server_key: "9b12c80f59066b3e6ce896dd38c7f2a9"
server_key_iv: "af64acc6c194c5c8b741aab403171bc7"
server_key_version: "encryptionkey@0"
I20260810 21:08:36.921557 12499 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:08:36.922379 12525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:36.922606 12499 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:36.922709 12499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "422b6ed677bf4b4e90400865ed8426fc"
format_stamp: "Formatted at 2026-08-10 21:08:36 on dist-test-slave-jq4t"
server_key: "9b12c80f59066b3e6ce896dd38c7f2a9"
server_key_iv: "af64acc6c194c5c8b741aab403171bc7"
server_key_version: "encryptionkey@0"
I20260810 21:08:36.922785 12499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:36.935047 12499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:36.937654 12499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:36.937824 12499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:36.938131 12499 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:36.938490 12499 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:36.938548 12499 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:36.938596 12499 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:36.938632 12499 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:36.945470 12499 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:38423
I20260810 21:08:36.945513 12706 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:38423 every 8 connection(s)
I20260810 21:08:36.945909 12499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
Aug 10 21:08:36 dist-test-slave-jq4t krb5kdc[12326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396116, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:08:36.953136 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 12499
I20260810 21:08:36.953282 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:08:36.953521 15508 external_mini_cluster.cc:1428] Setting key b138e225732c411446c2bcf712edd883
I20260810 21:08:36.956893 12465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:36.946919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:58463 (local address 127.15.37.62:36489)
0810 21:08:36.947018 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:36.947021 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:36.947217 (+ 196us) server_negotiation.cc:407] Connection header received
0810 21:08:36.947888 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:36.947889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:36.947904 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:36.947965 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:36.949063 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:36.949602 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:36.950726 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:36.950972 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:36.951068 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:36.953743 (+ 2675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:36.953744 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:36.953745 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:36.953753 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:36.955269 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:36.955714 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:36.955715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:36.955716 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:36.955781 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:36.956135 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:36.956137 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:36.956137 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:36.956284 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:36.956351 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:36.956740 (+ 389us) server_negotiation.cc:299] Negotiation successful
0810 21:08:36.956821 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260810 21:08:36.957264 12710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:36.946871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36489 (local address 127.15.37.1:58463)
0810 21:08:36.947069 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:36.947113 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:36.947757 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:36.948047 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:36.948051 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:36.948721 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:36.948947 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:36.948953 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:36.949716 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:36.949718 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:36.950613 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:36.950615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:36.951081 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:36.951083 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:36.951224 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:36.951852 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:08:36.951861 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:36.953639 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:36.955364 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:36.955374 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:36.955376 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:36.955630 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:36.955862 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:36.955863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:36.955863 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:36.956037 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:36.956363 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:36.956371 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:36.956588 (+ 217us) client_negotiation.cc:769] Sending connection context
0810 21:08:36.956723 (+ 135us) client_negotiation.cc:240] Negotiation successful
0810 21:08:36.956927 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260810 21:08:36.957868 12708 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36489
I20260810 21:08:36.957984 12708 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:36.958182 12708 heartbeater.cc:511] Master 127.15.37.62:36489 requested a full tablet report, sending...
I20260810 21:08:36.958803 12401 ts_manager.cc:194] Registered new tserver with Master: 422b6ed677bf4b4e90400865ed8426fc (127.15.37.1:38423)
I20260810 21:08:36.959820 12401 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:58463
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:08:36.984768 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36489
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:38033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:37.077682 12716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:37.077921 12716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:37.077947 12716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:37.079082 12716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:37.079118 12716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:37.079145 12716 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:08:37.080699 12716 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:38033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:37.080915 12716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:37.081110 12716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:37.086555 12728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:37.086577 12726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:37.086577 12725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:37.086874 12716 server_base.cc:1034] running on GCE node
I20260810 21:08:37.087126 12716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:37.087391 12716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:37.088552 12716 hybrid_clock.cc:648] HybridClock initialized: now 1786396117088538 us; error 32 us; skew 500 ppm
Aug 10 21:08:37 dist-test-slave-jq4t krb5kdc[12326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396117, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:37.091393 12716 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:08:37.091869 12716 webserver.cc:460] Webserver started at http://127.15.37.2:38841/ using document root <none> and password file <none>
I20260810 21:08:37.092109 12716 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:37.092156 12716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:37.092331 12716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:37.093505 12716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "553d5b328e2f448d9b3b07e1c1eb15ff"
format_stamp: "Formatted at 2026-08-10 21:08:37 on dist-test-slave-jq4t"
server_key: "91fc512189927363d86f8dd74748cdc7"
server_key_iv: "4d16e5cb7c77953692f165444f785230"
server_key_version: "encryptionkey@0"
I20260810 21:08:37.093899 12716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "553d5b328e2f448d9b3b07e1c1eb15ff"
format_stamp: "Formatted at 2026-08-10 21:08:37 on dist-test-slave-jq4t"
server_key: "91fc512189927363d86f8dd74748cdc7"
server_key_iv: "4d16e5cb7c77953692f165444f785230"
server_key_version: "encryptionkey@0"
I20260810 21:08:37.095307 12716 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:08:37.096048 12740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:37.096215 12716 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 21:08:37.096313 12716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "553d5b328e2f448d9b3b07e1c1eb15ff"
format_stamp: "Formatted at 2026-08-10 21:08:37 on dist-test-slave-jq4t"
server_key: "91fc512189927363d86f8dd74748cdc7"
server_key_iv: "4d16e5cb7c77953692f165444f785230"
server_key_version: "encryptionkey@0"
I20260810 21:08:37.096370 12716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:37.118868 12716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:37.121523 12716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:37.121654 12716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:37.121886 12716 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:37.122282 12716 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:37.122318 12716 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:37.122344 12716 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:37.122356 12716 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:37.128885 12716 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:41045
I20260810 21:08:37.128988 12922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:41045 every 8 connection(s)
I20260810 21:08:37.129386 12716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:08:37.132306 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 12716
I20260810 21:08:37.132452 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:08:37.132694 15508 external_mini_cluster.cc:1428] Setting key bbd67b0ba3b85949f245a7fd6d62e7ed
Aug 10 21:08:37 dist-test-slave-jq4t krb5kdc[12326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396117, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:08:37.140583 12465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.130256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:55533 (local address 127.15.37.62:36489)
0810 21:08:37.130324 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:37.130326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:37.130524 (+ 198us) server_negotiation.cc:407] Connection header received
0810 21:08:37.131054 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:37.131055 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:37.131066 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:37.131132 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:37.132173 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.132865 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.134408 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.134604 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.134664 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.137423 (+ 2759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:37.137426 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:37.137426 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:37.137435 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:37.139002 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:37.139459 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:37.139461 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:37.139461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:37.139529 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:37.139819 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:37.139820 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:37.139821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:37.139958 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:37.140038 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:37.140343 (+ 305us) server_negotiation.cc:299] Negotiation successful
0810 21:08:37.140458 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 21:08:37.140766 12928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.130195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36489 (local address 127.15.37.2:55533)
0810 21:08:37.130374 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:37.130419 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:37.130945 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:37.131212 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:37.131216 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:37.131833 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:37.132044 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.132048 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.133015 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.133016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.134311 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.134315 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.134697 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.134698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.134856 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.135579 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:08:37.135589 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:37.137300 (+ 1711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:37.139104 (+ 1804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:37.139114 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:37.139117 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:37.139367 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:37.139619 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:37.139620 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:37.139620 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:37.139741 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:37.140027 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:37.140036 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:37.140195 (+ 159us) client_negotiation.cc:769] Sending connection context
0810 21:08:37.140310 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 21:08:37.140522 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":97,"threads_started":1}
I20260810 21:08:37.141705 12926 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36489
I20260810 21:08:37.141801 12926 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:37.142021 12926 heartbeater.cc:511] Master 127.15.37.62:36489 requested a full tablet report, sending...
I20260810 21:08:37.142505 12401 ts_manager.cc:194] Registered new tserver with Master: 553d5b328e2f448d9b3b07e1c1eb15ff (127.15.37.2:41045)
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
I20260810 21:08:37.142966 12401 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:55533
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:08:37.163816 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36489
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:38033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:37.253026 12932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:37.253307 12932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:37.253355 12932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:37.254613 12932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:37.254665 12932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:37.254705 12932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:08:37.256286 12932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:38033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:36489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:37.256618 12932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:37.256875 12932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:37.262548 12940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:37.262637 12932 server_base.cc:1034] running on GCE node
W20260810 21:08:37.262559 12944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:37.262558 12941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:37.262995 12932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:37.263278 12932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:37.264457 12932 hybrid_clock.cc:648] HybridClock initialized: now 1786396117264454 us; error 45 us; skew 500 ppm
Aug 10 21:08:37 dist-test-slave-jq4t krb5kdc[12326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396117, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:37.267215 12932 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:08:37.267732 12932 webserver.cc:460] Webserver started at http://127.15.37.3:42073/ using document root <none> and password file <none>
I20260810 21:08:37.268002 12932 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:37.268077 12932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:37.268239 12932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:37.269446 12932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "35cf3868cc03492ca425a00d847e6fb3"
format_stamp: "Formatted at 2026-08-10 21:08:37 on dist-test-slave-jq4t"
server_key: "a4bf1c88b339e04ff74b691b36bad24f"
server_key_iv: "025a669e03acf3d01d7dfe09d7a06e1f"
server_key_version: "encryptionkey@0"
I20260810 21:08:37.269856 12932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "35cf3868cc03492ca425a00d847e6fb3"
format_stamp: "Formatted at 2026-08-10 21:08:37 on dist-test-slave-jq4t"
server_key: "a4bf1c88b339e04ff74b691b36bad24f"
server_key_iv: "025a669e03acf3d01d7dfe09d7a06e1f"
server_key_version: "encryptionkey@0"
I20260810 21:08:37.271337 12932 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 21:08:37.272174 12954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:37.272392 12932 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:37.272523 12932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "35cf3868cc03492ca425a00d847e6fb3"
format_stamp: "Formatted at 2026-08-10 21:08:37 on dist-test-slave-jq4t"
server_key: "a4bf1c88b339e04ff74b691b36bad24f"
server_key_iv: "025a669e03acf3d01d7dfe09d7a06e1f"
server_key_version: "encryptionkey@0"
I20260810 21:08:37.272624 12932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:37.317489 12932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:37.319939 12932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:37.320154 12932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:37.320436 12932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:37.320837 12932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:37.320897 12932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:37.320936 12932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:37.320984 12932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:37.327525 12932 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:41161
I20260810 21:08:37.327574 13147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:41161 every 8 connection(s)
I20260810 21:08:37.327939 12932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:08:37.331166 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 12932
I20260810 21:08:37.331296 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:08:37.331499 15508 external_mini_cluster.cc:1428] Setting key 8e9536a29913ca65dd6143311c90f865
Aug 10 21:08:37 dist-test-slave-jq4t krb5kdc[12326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396117, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:08:37.338963 12465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.328782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:59421 (local address 127.15.37.62:36489)
0810 21:08:37.328876 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:37.328879 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:37.329102 (+ 223us) server_negotiation.cc:407] Connection header received
0810 21:08:37.329735 (+ 633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:37.329737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:37.329751 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:37.329825 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:37.330887 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.331764 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.333288 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.333486 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.333546 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.335865 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:37.335867 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:37.335867 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:37.335875 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:37.337469 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:37.337949 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:37.337951 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:37.337952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:37.338019 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:37.338328 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:37.338329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:37.338330 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:37.338461 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:37.338518 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:37.338810 (+ 292us) server_negotiation.cc:299] Negotiation successful
0810 21:08:37.338885 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 21:08:37.339267 13152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.328729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:36489 (local address 127.15.37.3:59421)
0810 21:08:37.328937 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:37.328986 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:37.329563 (+ 577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:37.329884 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:37.329887 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:37.330518 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:37.330740 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.330745 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.331922 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.331924 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.333204 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.333207 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.333570 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.333571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.333679 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.334253 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:08:37.334262 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:37.335774 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:37.337565 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:37.337573 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:37.337575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:37.337834 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:37.338118 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:37.338119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:37.338119 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:37.338254 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:37.338531 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:37.338538 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:37.338686 (+ 148us) client_negotiation.cc:769] Sending connection context
0810 21:08:37.338781 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 21:08:37.338948 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":108,"threads_started":1}
I20260810 21:08:37.339918 13149 heartbeater.cc:347] Connected to a master server at 127.15.37.62:36489
I20260810 21:08:37.340049 13149 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:37.340220 13149 heartbeater.cc:511] Master 127.15.37.62:36489 requested a full tablet report, sending...
I20260810 21:08:37.340672 12401 ts_manager.cc:194] Registered new tserver with Master: 35cf3868cc03492ca425a00d847e6fb3 (127.15.37.3:41161)
I20260810 21:08:37.341112 12401 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:59421
I20260810 21:08:37.343639 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:08:37.351934 12465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.345284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48454 (local address 127.15.37.62:36489)
0810 21:08:37.345337 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:37.345339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:37.345460 (+ 121us) server_negotiation.cc:407] Connection header received
0810 21:08:37.345543 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:37.345544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:37.345556 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:37.345632 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:37.346238 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.346849 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.347624 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.347832 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.347909 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.349325 (+ 1416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:37.349326 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:37.349327 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:37.349334 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:37.350789 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:37.351171 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:37.351171 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:37.351172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:37.351225 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:37.351411 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:37.351412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:37.351412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:37.351554 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:37.351639 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:37.351743 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 21:08:37.351795 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 21:08:37.353765 12401 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48454:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:08:37.355443 12401 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:08:37.362406 13163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.357957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:41161 (local address 127.0.0.1:55834)
0810 21:08:37.358293 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:37.358303 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:37.358347 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:37.358871 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:37.358872 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:37.358874 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:37.358926 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.358927 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.359861 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.359862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.361284 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.361288 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.362052 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.362054 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.362140 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.362154 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 21:08:37.362246 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 21:08:37.362314 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"mutex_wait_us":2,"thread_start_us":58,"threads_started":1}
I20260810 21:08:37.362417 13166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.358093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55834 (local address 127.15.37.3:41161)
0810 21:08:37.358643 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:37.358648 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:37.358659 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:08:37.358766 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:37.358773 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:37.358795 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:37.358878 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:37.359058 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.359753 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.361382 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.361956 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.362050 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.362119 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:37.362281 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 21:08:37.362324 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":105,"threads_started":1}
I20260810 21:08:37.362697 13164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.357956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:38423 (local address 127.0.0.1:49792)
0810 21:08:37.358138 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:37.358180 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:37.358251 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:37.358665 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:37.358669 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:37.358672 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:37.358750 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.358753 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.360128 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.360129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.361291 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.361293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.362275 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.362276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.362368 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.362375 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 21:08:37.362419 (+ 44us) client_negotiation.cc:240] Negotiation successful
0810 21:08:37.362637 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":188,"thread_start_us":108,"threads_started":1}
I20260810 21:08:37.362778 13167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.358175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:41045 (local address 127.0.0.1:60694)
0810 21:08:37.358434 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:37.358447 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:37.358505 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:37.359041 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:37.359042 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:37.359044 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:37.359099 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.359100 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.360356 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.360357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.361391 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.361394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.362279 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.362279 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.362368 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.362374 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 21:08:37.362419 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 21:08:37.362476 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":25,"thread_start_us":62,"threads_started":1}
I20260810 21:08:37.363106 13169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.358417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60694 (local address 127.15.37.2:41045)
0810 21:08:37.358626 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:37.358630 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:37.358641 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:08:37.358683 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:37.358685 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:37.358700 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:37.359179 (+ 479us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:37.359252 (+ 73us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.360253 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.361481 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.362175 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.362845 (+ 670us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.362941 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:37.362970 (+ 29us) server_negotiation.cc:299] Negotiation successful
0810 21:08:37.363022 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":100,"threads_started":1}
I20260810 21:08:37.363166 13165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.358068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49792 (local address 127.15.37.1:38423)
0810 21:08:37.358414 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:37.358419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:37.358429 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:08:37.358473 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:37.358481 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:37.358494 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:37.358632 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:37.358829 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.360013 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.361394 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.362165 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.362941 (+ 776us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.363009 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:37.363033 (+ 24us) server_negotiation.cc:299] Negotiation successful
0810 21:08:37.363076 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":124,"threads_started":1}
I20260810 21:08:37.363312 13034 tablet_service.cc:1467] Processing CreateTablet for tablet 157cfa112f634e23aab1d72bc74db79d (DEFAULT_TABLE table=test-table [id=e10740c2a5fe4732bb1de8177c8806e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:37.363732 13034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 157cfa112f634e23aab1d72bc74db79d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:37.363772 12817 tablet_service.cc:1467] Processing CreateTablet for tablet 157cfa112f634e23aab1d72bc74db79d (DEFAULT_TABLE table=test-table [id=e10740c2a5fe4732bb1de8177c8806e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:37.363777 12600 tablet_service.cc:1467] Processing CreateTablet for tablet 157cfa112f634e23aab1d72bc74db79d (DEFAULT_TABLE table=test-table [id=e10740c2a5fe4732bb1de8177c8806e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:37.364157 12817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 157cfa112f634e23aab1d72bc74db79d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:37.364192 12600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 157cfa112f634e23aab1d72bc74db79d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:37.366918 13170 tablet_bootstrap.cc:492] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc: Bootstrap starting.
I20260810 21:08:37.367410 13172 tablet_bootstrap.cc:492] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3: Bootstrap starting.
I20260810 21:08:37.368042 13170 tablet_bootstrap.cc:654] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:37.368072 13172 tablet_bootstrap.cc:654] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:37.368649 13174 tablet_bootstrap.cc:492] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff: Bootstrap starting.
I20260810 21:08:37.368723 13170 log.cc:824] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:37.368748 13172 log.cc:824] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:37.369396 13174 tablet_bootstrap.cc:654] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:37.369552 13170 tablet_bootstrap.cc:492] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc: No bootstrap required, opened a new log
I20260810 21:08:37.369645 13170 ts_tablet_manager.cc:1397] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:08:37.369717 13172 tablet_bootstrap.cc:492] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3: No bootstrap required, opened a new log
I20260810 21:08:37.369827 13172 ts_tablet_manager.cc:1397] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:08:37.370005 13174 log.cc:824] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:37.370785 13174 tablet_bootstrap.cc:492] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff: No bootstrap required, opened a new log
I20260810 21:08:37.370877 13174 ts_tablet_manager.cc:1397] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:08:37.371713 13172 raft_consensus.cc:348] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b6ed677bf4b4e90400865ed8426fc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38423 } } peers { permanent_uuid: "35cf3868cc03492ca425a00d847e6fb3" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41161 } } peers { permanent_uuid: "553d5b328e2f448d9b3b07e1c1eb15ff" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 41045 } }
I20260810 21:08:37.371892 13172 raft_consensus.cc:374] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:37.371942 13172 raft_consensus.cc:729] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35cf3868cc03492ca425a00d847e6fb3, State: Initialized, Role: FOLLOWER
I20260810 21:08:37.371855 13170 raft_consensus.cc:348] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b6ed677bf4b4e90400865ed8426fc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38423 } } peers { permanent_uuid: "35cf3868cc03492ca425a00d847e6fb3" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41161 } } peers { permanent_uuid: "553d5b328e2f448d9b3b07e1c1eb15ff" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 41045 } }
I20260810 21:08:37.372028 13170 raft_consensus.cc:374] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:37.372076 13170 raft_consensus.cc:729] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 422b6ed677bf4b4e90400865ed8426fc, State: Initialized, Role: FOLLOWER
I20260810 21:08:37.372088 13172 consensus_queue.cc:260] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b6ed677bf4b4e90400865ed8426fc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38423 } } peers { permanent_uuid: "35cf3868cc03492ca425a00d847e6fb3" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41161 } } peers { permanent_uuid: "553d5b328e2f448d9b3b07e1c1eb15ff" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 41045 } }
I20260810 21:08:37.372193 13170 consensus_queue.cc:260] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b6ed677bf4b4e90400865ed8426fc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38423 } } peers { permanent_uuid: "35cf3868cc03492ca425a00d847e6fb3" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41161 } } peers { permanent_uuid: "553d5b328e2f448d9b3b07e1c1eb15ff" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 41045 } }
I20260810 21:08:37.372424 13172 ts_tablet_manager.cc:1428] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:08:37.372509 13170 ts_tablet_manager.cc:1428] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:08:37.372601 13149 heartbeater.cc:503] Master 127.15.37.62:36489 was elected leader, sending a full tablet report...
I20260810 21:08:37.372648 12708 heartbeater.cc:503] Master 127.15.37.62:36489 was elected leader, sending a full tablet report...
I20260810 21:08:37.373144 13174 raft_consensus.cc:348] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b6ed677bf4b4e90400865ed8426fc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38423 } } peers { permanent_uuid: "35cf3868cc03492ca425a00d847e6fb3" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41161 } } peers { permanent_uuid: "553d5b328e2f448d9b3b07e1c1eb15ff" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 41045 } }
I20260810 21:08:37.373449 13174 raft_consensus.cc:374] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:37.373713 13174 raft_consensus.cc:729] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 553d5b328e2f448d9b3b07e1c1eb15ff, State: Initialized, Role: FOLLOWER
I20260810 21:08:37.373871 13174 consensus_queue.cc:260] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b6ed677bf4b4e90400865ed8426fc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38423 } } peers { permanent_uuid: "35cf3868cc03492ca425a00d847e6fb3" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41161 } } peers { permanent_uuid: "553d5b328e2f448d9b3b07e1c1eb15ff" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 41045 } }
I20260810 21:08:37.374204 13174 ts_tablet_manager.cc:1428] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:08:37.374418 12926 heartbeater.cc:503] Master 127.15.37.62:36489 was elected leader, sending a full tablet report...
W20260810 21:08:37.380046 12927 tablet.cc:2369] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 21:08:37.446856 12709 tablet.cc:2369] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:08:37.462803 13178 raft_consensus.cc:482] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:08:37.462989 13178 raft_consensus.cc:504] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b6ed677bf4b4e90400865ed8426fc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38423 } } peers { permanent_uuid: "35cf3868cc03492ca425a00d847e6fb3" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41161 } } peers { permanent_uuid: "553d5b328e2f448d9b3b07e1c1eb15ff" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 41045 } }
I20260810 21:08:37.463508 13178 leader_election.cc:288] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 422b6ed677bf4b4e90400865ed8426fc (127.15.37.1:38423), 553d5b328e2f448d9b3b07e1c1eb15ff (127.15.37.2:41045)
I20260810 21:08:37.467939 13165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.463879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:43329 (local address 127.15.37.1:38423)
0810 21:08:37.463953 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:37.463955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:37.463968 (+ 13us) server_negotiation.cc:407] Connection header received
0810 21:08:37.464007 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:37.464008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:37.464022 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:37.464124 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:37.464331 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.465173 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.466915 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.467497 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.467580 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.467594 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:37.467802 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 21:08:37.467864 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 21:08:37.467939 13169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.464058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:34177 (local address 127.15.37.2:41045)
0810 21:08:37.464133 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:37.464135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:37.464229 (+ 94us) server_negotiation.cc:407] Connection header received
0810 21:08:37.464272 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:37.464273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:37.464304 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:37.464371 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:37.464545 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.465221 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.466898 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.467502 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.467580 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.467594 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:37.467801 (+ 207us) server_negotiation.cc:299] Negotiation successful
0810 21:08:37.467860 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 21:08:37.467938 13152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.463789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:38423 (local address 127.15.37.3:43329)
0810 21:08:37.463861 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:37.463883 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:37.463936 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:37.464158 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:37.464159 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:37.464161 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:37.464246 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.464248 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.465298 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.465299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.466776 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.466780 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.467595 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.467596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.467685 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.467692 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 21:08:37.467754 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 21:08:37.467820 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46,"mutex_wait_us":140}
I20260810 21:08:37.467947 13184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.463956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:41045 (local address 127.15.37.3:34177)
0810 21:08:37.464146 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:37.464156 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:37.464216 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:37.464384 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:37.464385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:37.464386 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:37.464440 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.464441 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.465298 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.465299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.466776 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.466780 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.467595 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.467596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.467685 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.467692 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 21:08:37.467753 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 21:08:37.467820 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":82,"thread_start_us":136,"threads_started":1}
I20260810 21:08:37.468451 12634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "157cfa112f634e23aab1d72bc74db79d" candidate_uuid: "35cf3868cc03492ca425a00d847e6fb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422b6ed677bf4b4e90400865ed8426fc" is_pre_election: true
I20260810 21:08:37.468719 12634 raft_consensus.cc:2454] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35cf3868cc03492ca425a00d847e6fb3 in term 0.
I20260810 21:08:37.468781 12851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "157cfa112f634e23aab1d72bc74db79d" candidate_uuid: "35cf3868cc03492ca425a00d847e6fb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553d5b328e2f448d9b3b07e1c1eb15ff" is_pre_election: true
I20260810 21:08:37.469142 12956 leader_election.cc:302] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35cf3868cc03492ca425a00d847e6fb3, 422b6ed677bf4b4e90400865ed8426fc; no voters:
I20260810 21:08:37.469184 12851 raft_consensus.cc:2454] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35cf3868cc03492ca425a00d847e6fb3 in term 0.
I20260810 21:08:37.469313 13178 raft_consensus.cc:2781] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:08:37.469413 13178 raft_consensus.cc:482] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:08:37.469466 13178 raft_consensus.cc:3037] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:37.470263 13178 raft_consensus.cc:504] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b6ed677bf4b4e90400865ed8426fc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38423 } } peers { permanent_uuid: "35cf3868cc03492ca425a00d847e6fb3" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41161 } } peers { permanent_uuid: "553d5b328e2f448d9b3b07e1c1eb15ff" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 41045 } }
I20260810 21:08:37.470418 13178 leader_election.cc:288] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [CANDIDATE]: Term 1 election: Requested vote from peers 422b6ed677bf4b4e90400865ed8426fc (127.15.37.1:38423), 553d5b328e2f448d9b3b07e1c1eb15ff (127.15.37.2:41045)
I20260810 21:08:37.470618 12634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "157cfa112f634e23aab1d72bc74db79d" candidate_uuid: "35cf3868cc03492ca425a00d847e6fb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "422b6ed677bf4b4e90400865ed8426fc"
I20260810 21:08:37.470665 12851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "157cfa112f634e23aab1d72bc74db79d" candidate_uuid: "35cf3868cc03492ca425a00d847e6fb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "553d5b328e2f448d9b3b07e1c1eb15ff"
I20260810 21:08:37.470732 12634 raft_consensus.cc:3037] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:37.470739 12851 raft_consensus.cc:3037] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:37.471604 12634 raft_consensus.cc:2454] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35cf3868cc03492ca425a00d847e6fb3 in term 1.
I20260810 21:08:37.471606 12851 raft_consensus.cc:2454] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35cf3868cc03492ca425a00d847e6fb3 in term 1.
I20260810 21:08:37.471807 12956 leader_election.cc:302] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35cf3868cc03492ca425a00d847e6fb3, 422b6ed677bf4b4e90400865ed8426fc; no voters:
I20260810 21:08:37.471946 13178 raft_consensus.cc:2781] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:37.472163 13178 raft_consensus.cc:686] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [term 1 LEADER]: Becoming Leader. State: Replica: 35cf3868cc03492ca425a00d847e6fb3, State: Running, Role: LEADER
I20260810 21:08:37.472278 13178 consensus_queue.cc:237] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b6ed677bf4b4e90400865ed8426fc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38423 } } peers { permanent_uuid: "35cf3868cc03492ca425a00d847e6fb3" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41161 } } peers { permanent_uuid: "553d5b328e2f448d9b3b07e1c1eb15ff" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 41045 } }
I20260810 21:08:37.473357 12401 catalog_manager.cc:5495] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 35cf3868cc03492ca425a00d847e6fb3 (127.15.37.3). New cstate: current_term: 1 leader_uuid: "35cf3868cc03492ca425a00d847e6fb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "422b6ed677bf4b4e90400865ed8426fc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35cf3868cc03492ca425a00d847e6fb3" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 41161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "553d5b328e2f448d9b3b07e1c1eb15ff" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 41045 } health_report { overall_health: UNKNOWN } } }
I20260810 21:08:37.485590 13166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.482878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55840 (local address 127.15.37.3:41161)
0810 21:08:37.482990 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:37.482992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:37.483002 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:08:37.483059 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:37.483060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:37.483085 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:37.483174 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:08:37.483337 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.483855 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.484743 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.484949 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.485027 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.485211 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:08:37.485310 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:08:37.485425 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:37.485483 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 21:08:37.485494 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260810 21:08:37.487799 12851 raft_consensus.cc:1261] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff [term 1 FOLLOWER]: Refusing update from remote peer 35cf3868cc03492ca425a00d847e6fb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:08:37.487800 12634 raft_consensus.cc:1261] T 157cfa112f634e23aab1d72bc74db79d P 422b6ed677bf4b4e90400865ed8426fc [term 1 FOLLOWER]: Refusing update from remote peer 35cf3868cc03492ca425a00d847e6fb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:08:37.488296 13185 consensus_queue.cc:1035] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "422b6ed677bf4b4e90400865ed8426fc" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 38423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:08:37.488461 13178 consensus_queue.cc:1035] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "553d5b328e2f448d9b3b07e1c1eb15ff" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:08:37.491608 13189 mvcc.cc:205] Tried to move back new op lower bound from 7317078497226752000 to 7317078497167556608. Current Snapshot: MvccSnapshot[applied={T|T < 7317078497226752000}]
I20260810 21:08:37.491814 13190 mvcc.cc:205] Tried to move back new op lower bound from 7317078497226752000 to 7317078497167556608. Current Snapshot: MvccSnapshot[applied={T|T < 7317078497226752000}]
I20260810 21:08:37.493868 12400 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:08:37.494011 12400 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48454:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:08:37.494908 12400 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f5112ef8dfc43a3bf958195da4520bf: Sending DeleteTablet for 3 replicas of tablet 157cfa112f634e23aab1d72bc74db79d
I20260810 21:08:37.495352 12600 tablet_service.cc:1514] Processing DeleteTablet for tablet 157cfa112f634e23aab1d72bc74db79d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:37 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:49792
I20260810 21:08:37.495395 13034 tablet_service.cc:1514] Processing DeleteTablet for tablet 157cfa112f634e23aab1d72bc74db79d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:37 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:55834
I20260810 21:08:37.495635 12817 tablet_service.cc:1514] Processing DeleteTablet for tablet 157cfa112f634e23aab1d72bc74db79d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:37 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:60694
I20260810 21:08:37.495887 13206 tablet_replica.cc:330] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff: stopping tablet replica
I20260810 21:08:37.496016 13206 raft_consensus.cc:2229] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:08:37.496142 13206 raft_consensus.cc:2258] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:08:37.496204 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 12499
I20260810 21:08:37.511333 13206 ts_tablet_manager.cc:1905] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:08:37.512624 13202 tablet_replica.cc:330] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3: stopping tablet replica
I20260810 21:08:37.512776 13202 raft_consensus.cc:2229] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:08:37.512907 13202 raft_consensus.cc:2258] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:08:37.514201 13202 ts_tablet_manager.cc:1905] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:08:37.515003 13206 ts_tablet_manager.cc:1918] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:08:37.515193 13206 log.cc:1196] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/157cfa112f634e23aab1d72bc74db79d
I20260810 21:08:37.515610 13206 ts_tablet_manager.cc:1939] T 157cfa112f634e23aab1d72bc74db79d P 553d5b328e2f448d9b3b07e1c1eb15ff: Deleting consensus metadata
I20260810 21:08:37.516259 12374 catalog_manager.cc:4841] TS 553d5b328e2f448d9b3b07e1c1eb15ff (127.15.37.2:41045): tablet 157cfa112f634e23aab1d72bc74db79d (table test-table [id=e10740c2a5fe4732bb1de8177c8806e0]) successfully deleted
I20260810 21:08:37.516583 13202 ts_tablet_manager.cc:1918] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:08:37.516676 13202 log.cc:1196] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/157cfa112f634e23aab1d72bc74db79d
I20260810 21:08:37.516986 13202 ts_tablet_manager.cc:1939] T 157cfa112f634e23aab1d72bc74db79d P 35cf3868cc03492ca425a00d847e6fb3: Deleting consensus metadata
I20260810 21:08:37.517479 12377 catalog_manager.cc:4841] TS 35cf3868cc03492ca425a00d847e6fb3 (127.15.37.3:41161): tablet 157cfa112f634e23aab1d72bc74db79d (table test-table [id=e10740c2a5fe4732bb1de8177c8806e0]) successfully deleted
W20260810 21:08:37.519023 12374 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:38423 (error 108)
I20260810 21:08:37.519335 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 12716
I20260810 21:08:37.519963 13164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.519514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:38423 (local address 127.0.0.1:49794)
0810 21:08:37.519880 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:37.519925 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:38423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342}
W20260810 21:08:37.534245 12374 catalog_manager.cc:4584] TS 422b6ed677bf4b4e90400865ed8426fc (127.15.37.1:38423): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 157cfa112f634e23aab1d72bc74db79d: Network error: Client connection negotiation failed: client connection to 127.15.37.1:38423: connect: Connection refused (error 111)
I20260810 21:08:37.539826 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 12932
I20260810 21:08:37.559208 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 12349
2026-08-10T21:08:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2368 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-10T21:08:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:37Z Disabled control of system clock
I20260810 21:08:37.596114 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:46283
--webserver_interface=127.15.37.62
--webserver_port=0
--builtin_ntp_servers=127.15.37.20:37173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:46283
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 21:08:37.691105 13213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:37.691382 13213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:37.691406 13213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:37.692655 13213 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:37.692701 13213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:37.692714 13213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:37.692726 13213 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:37.692739 13213 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:37.694118 13213 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:46283
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:46283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13213
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:37.694343 13213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:37.694612 13213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:37.699856 13218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:37.700031 13213 server_base.cc:1034] running on GCE node
W20260810 21:08:37.700120 13221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:37.699908 13219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:37.700541 13213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:37.700932 13213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:37.702111 13213 hybrid_clock.cc:648] HybridClock initialized: now 1786396117702101 us; error 51 us; skew 500 ppm
I20260810 21:08:37.703573 13213 webserver.cc:460] Webserver started at http://127.15.37.62:36799/ using document root <none> and password file <none>
I20260810 21:08:37.703845 13213 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:37.703949 13213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:37.704115 13213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:37.705338 13213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "f004e1c40cd845409702ebbb2b98f186"
format_stamp: "Formatted at 2026-08-10 21:08:37 on dist-test-slave-jq4t"
server_key: "3a280b7e0cefc7d606c6ea74230d3809"
server_key_iv: "3f3bd87bd536aec94069ac14276b5c29"
server_key_version: "encryptionkey@0"
I20260810 21:08:37.705734 13213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "f004e1c40cd845409702ebbb2b98f186"
format_stamp: "Formatted at 2026-08-10 21:08:37 on dist-test-slave-jq4t"
server_key: "3a280b7e0cefc7d606c6ea74230d3809"
server_key_iv: "3f3bd87bd536aec94069ac14276b5c29"
server_key_version: "encryptionkey@0"
I20260810 21:08:37.707132 13213 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 21:08:37.707911 13237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:37.708092 13213 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 21:08:37.708209 13213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "f004e1c40cd845409702ebbb2b98f186"
format_stamp: "Formatted at 2026-08-10 21:08:37 on dist-test-slave-jq4t"
server_key: "3a280b7e0cefc7d606c6ea74230d3809"
server_key_iv: "3f3bd87bd536aec94069ac14276b5c29"
server_key_version: "encryptionkey@0"
I20260810 21:08:37.708293 13213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:37.730163 13213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:37.730579 13213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:37.730759 13213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:37.735306 13213 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:46283
I20260810 21:08:37.735349 13331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:46283 every 8 connection(s)
I20260810 21:08:37.735742 13213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:37.736924 13334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:37.739709 13334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186: Bootstrap starting.
I20260810 21:08:37.740388 13334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:37.740761 13334 log.cc:824] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:37.741595 13334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186: No bootstrap required, opened a new log
I20260810 21:08:37.742080 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 13213
I20260810 21:08:37.742230 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:37.742460 15508 external_mini_cluster.cc:1428] Setting key 1002215426c5edfc2cecc05e09271223
I20260810 21:08:37.744064 13334 raft_consensus.cc:348] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f004e1c40cd845409702ebbb2b98f186" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46283 } }
I20260810 21:08:37.744258 13334 raft_consensus.cc:374] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:37.744299 13334 raft_consensus.cc:729] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f004e1c40cd845409702ebbb2b98f186, State: Initialized, Role: FOLLOWER
I20260810 21:08:37.744445 13334 consensus_queue.cc:260] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f004e1c40cd845409702ebbb2b98f186" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46283 } }
I20260810 21:08:37.744593 13334 raft_consensus.cc:388] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:37.744630 13334 raft_consensus.cc:482] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:37.744690 13334 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:37.745546 13334 raft_consensus.cc:504] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f004e1c40cd845409702ebbb2b98f186" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46283 } }
I20260810 21:08:37.745671 13334 leader_election.cc:302] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f004e1c40cd845409702ebbb2b98f186; no voters:
I20260810 21:08:37.745858 13334 leader_election.cc:288] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:37.745949 13344 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:37.746122 13344 raft_consensus.cc:686] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [term 1 LEADER]: Becoming Leader. State: Replica: f004e1c40cd845409702ebbb2b98f186, State: Running, Role: LEADER
I20260810 21:08:37.746165 13334 sys_catalog.cc:564] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:37.746220 13344 consensus_queue.cc:237] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f004e1c40cd845409702ebbb2b98f186" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46283 } }
I20260810 21:08:37.746678 13345 sys_catalog.cc:455] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f004e1c40cd845409702ebbb2b98f186" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f004e1c40cd845409702ebbb2b98f186" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46283 } } }
I20260810 21:08:37.746771 13345 sys_catalog.cc:458] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:37.747023 13355 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:37.747061 13347 sys_catalog.cc:455] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f004e1c40cd845409702ebbb2b98f186. Latest consensus state: current_term: 1 leader_uuid: "f004e1c40cd845409702ebbb2b98f186" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f004e1c40cd845409702ebbb2b98f186" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46283 } } }
I20260810 21:08:37.747216 13347 sys_catalog.cc:458] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:37.747617 13355 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:37.749789 13355 catalog_manager.cc:1347] Generated new cluster ID: 8fae05672b7543ba8d9f80d18fb5e7b0
I20260810 21:08:37.749848 13355 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:08:37.750334 13343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.743094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55690 (local address 127.15.37.62:46283)
0810 21:08:37.743346 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:37.743355 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:37.743392 (+ 37us) server_negotiation.cc:407] Connection header received
0810 21:08:37.744017 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:37.744026 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:37.744114 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:37.744274 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:37.744584 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.746496 (+ 1912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.747831 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.748503 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.748629 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.749439 (+ 810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:37.749444 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:37.749445 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:37.749658 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:37.749701 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:37.749717 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:37.749992 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:37.750027 (+ 35us) server_negotiation.cc:299] Negotiation successful
0810 21:08:37.750113 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":94,"threads_started":1}
I20260810 21:08:37.767431 13355 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:37.769062 13355 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:37.784449 13355 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186: Generated new TSK 0
I20260810 21:08:37.784782 13355 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:37.793758 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:46283
--builtin_ntp_servers=127.15.37.20:37173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 21:08:37.885258 13372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:37.885562 13372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:37.885610 13372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:37.886962 13372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:37.887009 13372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:37.887038 13372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:08:37.888468 13372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:46283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:37.888724 13372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:37.889034 13372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 21:08:37.894762 13372 server_base.cc:1034] running on GCE node
W20260810 21:08:37.894758 13382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:37.894730 13381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:37.894742 13385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:37.895162 13372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:37.895498 13372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:37.896670 13372 hybrid_clock.cc:648] HybridClock initialized: now 1786396117896653 us; error 30 us; skew 500 ppm
I20260810 21:08:37.898267 13372 webserver.cc:460] Webserver started at http://127.15.37.1:33253/ using document root <none> and password file <none>
I20260810 21:08:37.898573 13372 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:37.898655 13372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:37.898825 13372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:37.900082 13372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "b34480143d044cb291384d4cc8ce282e"
format_stamp: "Formatted at 2026-08-10 21:08:37 on dist-test-slave-jq4t"
server_key: "5f6321b7911de7aa5983a1648e909346"
server_key_iv: "da19327613d932f804318435d87f1ff8"
server_key_version: "encryptionkey@0"
I20260810 21:08:37.900466 13372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "b34480143d044cb291384d4cc8ce282e"
format_stamp: "Formatted at 2026-08-10 21:08:37 on dist-test-slave-jq4t"
server_key: "5f6321b7911de7aa5983a1648e909346"
server_key_iv: "da19327613d932f804318435d87f1ff8"
server_key_version: "encryptionkey@0"
I20260810 21:08:37.901986 13372 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:08:37.902773 13395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:37.902974 13372 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:08:37.903090 13372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "b34480143d044cb291384d4cc8ce282e"
format_stamp: "Formatted at 2026-08-10 21:08:37 on dist-test-slave-jq4t"
server_key: "5f6321b7911de7aa5983a1648e909346"
server_key_iv: "da19327613d932f804318435d87f1ff8"
server_key_version: "encryptionkey@0"
I20260810 21:08:37.903175 13372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:37.924894 13372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:37.925302 13372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:37.925487 13372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:37.925760 13372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:37.926174 13372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:37.926235 13372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:37.926280 13372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:37.926323 13372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:37.932775 13372 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:43739
I20260810 21:08:37.932833 13600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:43739 every 8 connection(s)
I20260810 21:08:37.933228 13372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:08:37.938781 13343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.934130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:40825 (local address 127.15.37.62:46283)
0810 21:08:37.934236 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:37.934238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:37.934464 (+ 226us) server_negotiation.cc:407] Connection header received
0810 21:08:37.934971 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:37.934973 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:37.934987 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:37.935046 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:37.935764 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.936289 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.937396 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.937600 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.937659 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.938516 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:37.938518 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:37.938518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:37.938523 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:37.938541 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:37.938545 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:37.938589 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:37.938681 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 21:08:37.938713 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 21:08:37.938983 13604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:37.934088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46283 (local address 127.15.37.1:40825)
0810 21:08:37.934325 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:37.934364 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:37.934882 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:37.935116 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:37.935120 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:37.935128 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:37.935678 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.935682 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.936379 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.936379 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.937300 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:37.937303 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:37.937685 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:37.937686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:37.937806 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:37.938367 (+ 561us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:08:37.938368 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:37.938400 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:08:37.938425 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:37.938602 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:37.938607 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:37.938610 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:08:37.938665 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 21:08:37.938756 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":128,"threads_started":1}
I20260810 21:08:37.939525 13601 heartbeater.cc:347] Connected to a master server at 127.15.37.62:46283
I20260810 21:08:37.939630 13601 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:37.939797 13601 heartbeater.cc:511] Master 127.15.37.62:46283 requested a full tablet report, sending...
I20260810 21:08:37.940373 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 13372
I20260810 21:08:37.940398 13262 ts_manager.cc:194] Registered new tserver with Master: b34480143d044cb291384d4cc8ce282e (127.15.37.1:43739)
I20260810 21:08:37.940537 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:08:37.940771 15508 external_mini_cluster.cc:1428] Setting key 75490b9dbb37cd8073a98b4ea4bab96c
I20260810 21:08:37.941264 13262 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.37.1:40825
I20260810 21:08:37.942129 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:46283
--builtin_ntp_servers=127.15.37.20:37173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 21:08:38.033301 13606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:38.033571 13606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:38.033597 13606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:38.034933 13606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:38.034993 13606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:38.035023 13606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:08:38.036661 13606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:46283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:38.036993 13606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:38.037365 13606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:38.043054 13614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:38.043090 13612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:38.043061 13616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:38.043287 13606 server_base.cc:1034] running on GCE node
I20260810 21:08:38.043723 13606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:38.044003 13606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:38.045178 13606 hybrid_clock.cc:648] HybridClock initialized: now 1786396118045168 us; error 30 us; skew 500 ppm
I20260810 21:08:38.046698 13606 webserver.cc:460] Webserver started at http://127.15.37.2:37359/ using document root <none> and password file <none>
I20260810 21:08:38.046999 13606 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:38.047051 13606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:38.047286 13606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:38.048543 13606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "b3b8afb689f54f599b025e2089d48f11"
format_stamp: "Formatted at 2026-08-10 21:08:38 on dist-test-slave-jq4t"
server_key: "53e07f91c20e296f128649da9c0a347a"
server_key_iv: "bd05f9fbe8e8a4e1d6c99d665dfe61af"
server_key_version: "encryptionkey@0"
I20260810 21:08:38.048972 13606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "b3b8afb689f54f599b025e2089d48f11"
format_stamp: "Formatted at 2026-08-10 21:08:38 on dist-test-slave-jq4t"
server_key: "53e07f91c20e296f128649da9c0a347a"
server_key_iv: "bd05f9fbe8e8a4e1d6c99d665dfe61af"
server_key_version: "encryptionkey@0"
I20260810 21:08:38.050412 13606 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:08:38.051337 13629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:38.051554 13606 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:38.051674 13606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "b3b8afb689f54f599b025e2089d48f11"
format_stamp: "Formatted at 2026-08-10 21:08:38 on dist-test-slave-jq4t"
server_key: "53e07f91c20e296f128649da9c0a347a"
server_key_iv: "bd05f9fbe8e8a4e1d6c99d665dfe61af"
server_key_version: "encryptionkey@0"
I20260810 21:08:38.051757 13606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:38.062443 13606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:38.062840 13606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:38.063015 13606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:38.063283 13606 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:38.063710 13606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:38.063774 13606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:38.063818 13606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:38.063865 13606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:38.070227 13606 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:46567
I20260810 21:08:38.070336 13810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:46567 every 8 connection(s)
I20260810 21:08:38.070712 13606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:08:38.076383 13343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.071627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:54905 (local address 127.15.37.62:46283)
0810 21:08:38.071728 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:38.071730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:38.071975 (+ 245us) server_negotiation.cc:407] Connection header received
0810 21:08:38.072601 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:38.072602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:38.072615 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:38.072672 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:38.073374 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.073884 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.074977 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.075179 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.075230 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.076128 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:38.076130 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:38.076130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:38.076134 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:38.076151 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:38.076155 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:38.076200 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:38.076287 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 21:08:38.076315 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 21:08:38.076646 13813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.071593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46283 (local address 127.15.37.2:54905)
0810 21:08:38.071836 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:38.071874 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:38.072425 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:38.072732 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:38.072735 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:38.072744 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:38.073292 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.073297 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.074013 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.074014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.074866 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.074868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.075260 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.075261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.075383 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.075980 (+ 597us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:08:38.075980 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:38.076010 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:08:38.076035 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:38.076210 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:38.076215 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:38.076217 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 21:08:38.076271 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 21:08:38.076366 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":134,"threads_started":1}
I20260810 21:08:38.077260 13811 heartbeater.cc:347] Connected to a master server at 127.15.37.62:46283
I20260810 21:08:38.077369 13811 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:38.077551 13811 heartbeater.cc:511] Master 127.15.37.62:46283 requested a full tablet report, sending...
I20260810 21:08:38.077936 13261 ts_manager.cc:194] Registered new tserver with Master: b3b8afb689f54f599b025e2089d48f11 (127.15.37.2:46567)
I20260810 21:08:38.078357 13261 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.37.2:54905
I20260810 21:08:38.078550 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 13606
I20260810 21:08:38.078696 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:08:38.078934 15508 external_mini_cluster.cc:1428] Setting key 79ca55bbe824034538ac63f0b6201e50
I20260810 21:08:38.079950 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:46283
--builtin_ntp_servers=127.15.37.20:37173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 21:08:38.170440 13817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:38.170683 13817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:38.170708 13817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:38.171988 13817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:38.172041 13817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:38.172070 13817 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:08:38.173629 13817 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:46283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:38.173930 13817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:38.174280 13817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:38.179925 13832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:38.179929 13826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:38.179950 13825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:38.179978 13817 server_base.cc:1034] running on GCE node
I20260810 21:08:38.180482 13817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:38.180791 13817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:38.181970 13817 hybrid_clock.cc:648] HybridClock initialized: now 1786396118181951 us; error 45 us; skew 500 ppm
I20260810 21:08:38.183409 13817 webserver.cc:460] Webserver started at http://127.15.37.3:37217/ using document root <none> and password file <none>
I20260810 21:08:38.183720 13817 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:38.183797 13817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:38.183979 13817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:38.185405 13817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "e6f245141a684c47a1676173cb39af3d"
format_stamp: "Formatted at 2026-08-10 21:08:38 on dist-test-slave-jq4t"
server_key: "669715fefbb34978041f6adecd472d8c"
server_key_iv: "3a8f3e3b2cdb159f8bbc2f85844e6812"
server_key_version: "encryptionkey@0"
I20260810 21:08:38.185832 13817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "e6f245141a684c47a1676173cb39af3d"
format_stamp: "Formatted at 2026-08-10 21:08:38 on dist-test-slave-jq4t"
server_key: "669715fefbb34978041f6adecd472d8c"
server_key_iv: "3a8f3e3b2cdb159f8bbc2f85844e6812"
server_key_version: "encryptionkey@0"
I20260810 21:08:38.187500 13817 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 21:08:38.188557 13838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:38.188776 13817 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:38.188889 13817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "e6f245141a684c47a1676173cb39af3d"
format_stamp: "Formatted at 2026-08-10 21:08:38 on dist-test-slave-jq4t"
server_key: "669715fefbb34978041f6adecd472d8c"
server_key_iv: "3a8f3e3b2cdb159f8bbc2f85844e6812"
server_key_version: "encryptionkey@0"
I20260810 21:08:38.188992 13817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:38.202666 13817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:38.203085 13817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:38.203265 13817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:38.203576 13817 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:38.203989 13817 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:38.204051 13817 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:38.204088 13817 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:38.204139 13817 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:38.211057 13817 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:34391
I20260810 21:08:38.211123 14019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:34391 every 8 connection(s)
I20260810 21:08:38.211575 13817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:08:38.216802 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 13817
I20260810 21:08:38.216958 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:08:38.217227 15508 external_mini_cluster.cc:1428] Setting key 4cbd3fd4d19963522e3540f4e76d07a6
I20260810 21:08:38.217911 13343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.212458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:59107 (local address 127.15.37.62:46283)
0810 21:08:38.212566 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:38.212574 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:38.212899 (+ 325us) server_negotiation.cc:407] Connection header received
0810 21:08:38.213421 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:38.213422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:38.213435 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:38.213492 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:38.214292 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.214830 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.216013 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.216234 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.216303 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.217525 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:38.217527 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:38.217528 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:38.217535 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:38.217557 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:38.217563 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:38.217622 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:38.217751 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 21:08:38.217792 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260810 21:08:38.218210 14022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.212529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:46283 (local address 127.15.37.3:59107)
0810 21:08:38.212758 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:38.212797 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:38.213323 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:38.213552 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:38.213555 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:38.213563 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:38.214145 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.214150 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.214958 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.214960 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.215859 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.215862 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.216340 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.216341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.216565 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.217316 (+ 751us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:08:38.217317 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:38.217361 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:08:38.217395 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:38.217643 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:38.217652 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:38.217655 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:08:38.217738 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 21:08:38.217885 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":111,"threads_started":1}
I20260810 21:08:38.218674 14020 heartbeater.cc:347] Connected to a master server at 127.15.37.62:46283
I20260810 21:08:38.218806 14020 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:38.219023 14020 heartbeater.cc:511] Master 127.15.37.62:46283 requested a full tablet report, sending...
I20260810 21:08:38.219493 13261 ts_manager.cc:194] Registered new tserver with Master: e6f245141a684c47a1676173cb39af3d (127.15.37.3:34391)
I20260810 21:08:38.219897 13261 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.37.3:59107
I20260810 21:08:38.229496 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:08:38.234412 13343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.231176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55698 (local address 127.15.37.62:46283)
0810 21:08:38.231273 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:38.231275 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:38.231327 (+ 52us) server_negotiation.cc:407] Connection header received
0810 21:08:38.231374 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:38.231375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:38.231389 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:38.231447 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:38.231590 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.232172 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.233057 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.233253 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.233321 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.234111 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:38.234113 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:38.234113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:38.234118 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:38.234131 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:38.234134 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:38.234203 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:38.234263 (+ 60us) server_negotiation.cc:299] Negotiation successful
0810 21:08:38.234296 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260810 21:08:38.236394 13261 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:08:38.238075 13261 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:08:38.245024 14034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.240679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:34391 (local address 127.0.0.1:41036)
0810 21:08:38.240920 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:38.240990 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:38.241065 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:38.241497 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:38.241501 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:38.241504 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:38.241596 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.241598 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.243026 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.243027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.243865 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.243867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.244605 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.244606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.244694 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.244708 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 21:08:38.244861 (+ 153us) client_negotiation.cc:240] Negotiation successful
0810 21:08:38.244930 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":105,"threads_started":1}
I20260810 21:08:38.245527 14040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.241018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41036 (local address 127.15.37.3:34391)
0810 21:08:38.241261 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:38.241265 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:38.241278 (+ 13us) server_negotiation.cc:407] Connection header received
0810 21:08:38.241328 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:38.241330 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:38.241348 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:38.241481 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:38.241671 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.242911 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.243961 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.244525 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.244603 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.244708 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:38.245417 (+ 709us) server_negotiation.cc:299] Negotiation successful
0810 21:08:38.245456 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":120,"threads_started":1}
I20260810 21:08:38.246018 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.240679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:43739 (local address 127.0.0.1:33552)
0810 21:08:38.241297 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:38.241308 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:38.241405 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:38.241690 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:38.241691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:38.241693 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:38.241754 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.241755 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.243963 (+ 2208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.243963 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.244730 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.244732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.245783 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.245784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.245845 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.245849 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:08:38.245904 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 21:08:38.245944 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"mutex_wait_us":4,"thread_start_us":96,"threads_started":1}
I20260810 21:08:38.246408 14041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.241103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33552 (local address 127.15.37.1:43739)
0810 21:08:38.241311 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:38.241315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:38.241471 (+ 156us) server_negotiation.cc:407] Connection header received
0810 21:08:38.241536 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:38.241539 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:38.241554 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:38.241621 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:38.241836 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.242930 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.244830 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.245588 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.245666 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.246250 (+ 584us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:38.246279 (+ 29us) server_negotiation.cc:299] Negotiation successful
0810 21:08:38.246320 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":99,"threads_started":1}
I20260810 21:08:38.246340 13928 tablet_service.cc:1467] Processing CreateTablet for tablet 815d8312f0814db1b05b3c7d65a9d165 (DEFAULT_TABLE table=test-table [id=736d299bf07e432a9d2da4f8fdf7c9ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:38.246796 13928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 815d8312f0814db1b05b3c7d65a9d165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:38.247133 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.240679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:46567 (local address 127.0.0.1:39570)
0810 21:08:38.241829 (+ 1150us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:38.241838 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:38.241912 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:38.242099 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:38.242100 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:38.242101 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:38.242141 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.242143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.244561 (+ 2418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.244562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.245622 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.245626 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.246851 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.246852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.246917 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.246921 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:08:38.247003 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 21:08:38.247050 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1139,"mutex_wait_us":25,"thread_start_us":84,"threads_started":1}
I20260810 21:08:38.247171 14038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.240902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39570 (local address 127.15.37.2:46567)
0810 21:08:38.241071 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:38.241077 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:38.241917 (+ 840us) server_negotiation.cc:407] Connection header received
0810 21:08:38.241981 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:38.241984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:38.241999 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:38.242100 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:38.242201 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.242926 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.245729 (+ 2803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.246568 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.246619 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.246747 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:38.247036 (+ 289us) server_negotiation.cc:299] Negotiation successful
0810 21:08:38.247090 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":93,"threads_started":1}
I20260810 21:08:38.247148 13482 tablet_service.cc:1467] Processing CreateTablet for tablet 815d8312f0814db1b05b3c7d65a9d165 (DEFAULT_TABLE table=test-table [id=736d299bf07e432a9d2da4f8fdf7c9ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:38.247527 13482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 815d8312f0814db1b05b3c7d65a9d165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:38.250066 14042 tablet_bootstrap.cc:492] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d: Bootstrap starting.
I20260810 21:08:38.250977 14042 tablet_bootstrap.cc:654] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:38.251096 13708 tablet_service.cc:1467] Processing CreateTablet for tablet 815d8312f0814db1b05b3c7d65a9d165 (DEFAULT_TABLE table=test-table [id=736d299bf07e432a9d2da4f8fdf7c9ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:38.251339 14042 log.cc:824] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:38.251487 13708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 815d8312f0814db1b05b3c7d65a9d165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:38.251746 14043 tablet_bootstrap.cc:492] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e: Bootstrap starting.
I20260810 21:08:38.252329 14043 tablet_bootstrap.cc:654] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:38.252689 14043 log.cc:824] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:38.253289 14042 tablet_bootstrap.cc:492] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d: No bootstrap required, opened a new log
I20260810 21:08:38.253397 14042 ts_tablet_manager.cc:1397] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:08:38.253517 14043 tablet_bootstrap.cc:492] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e: No bootstrap required, opened a new log
I20260810 21:08:38.253602 14043 ts_tablet_manager.cc:1397] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 21:08:38.255041 14047 tablet_bootstrap.cc:492] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11: Bootstrap starting.
I20260810 21:08:38.255739 14047 tablet_bootstrap.cc:654] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:38.256167 14047 log.cc:824] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:38.256119 14043 raft_consensus.cc:348] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b34480143d044cb291384d4cc8ce282e" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43739 } } peers { permanent_uuid: "e6f245141a684c47a1676173cb39af3d" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 34391 } } peers { permanent_uuid: "b3b8afb689f54f599b025e2089d48f11" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46567 } }
I20260810 21:08:38.256287 14043 raft_consensus.cc:374] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:38.256330 14043 raft_consensus.cc:729] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b34480143d044cb291384d4cc8ce282e, State: Initialized, Role: FOLLOWER
I20260810 21:08:38.256285 14042 raft_consensus.cc:348] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b34480143d044cb291384d4cc8ce282e" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43739 } } peers { permanent_uuid: "e6f245141a684c47a1676173cb39af3d" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 34391 } } peers { permanent_uuid: "b3b8afb689f54f599b025e2089d48f11" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46567 } }
I20260810 21:08:38.256469 14042 raft_consensus.cc:374] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:38.256451 14043 consensus_queue.cc:260] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b34480143d044cb291384d4cc8ce282e" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43739 } } peers { permanent_uuid: "e6f245141a684c47a1676173cb39af3d" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 34391 } } peers { permanent_uuid: "b3b8afb689f54f599b025e2089d48f11" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46567 } }
I20260810 21:08:38.256541 14042 raft_consensus.cc:729] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f245141a684c47a1676173cb39af3d, State: Initialized, Role: FOLLOWER
I20260810 21:08:38.256682 14042 consensus_queue.cc:260] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b34480143d044cb291384d4cc8ce282e" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43739 } } peers { permanent_uuid: "e6f245141a684c47a1676173cb39af3d" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 34391 } } peers { permanent_uuid: "b3b8afb689f54f599b025e2089d48f11" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46567 } }
I20260810 21:08:38.256755 14043 ts_tablet_manager.cc:1428] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260810 21:08:38.256901 13601 heartbeater.cc:503] Master 127.15.37.62:46283 was elected leader, sending a full tablet report...
I20260810 21:08:38.256969 14042 ts_tablet_manager.cc:1428] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260810 21:08:38.257100 14020 heartbeater.cc:503] Master 127.15.37.62:46283 was elected leader, sending a full tablet report...
I20260810 21:08:38.257248 14047 tablet_bootstrap.cc:492] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11: No bootstrap required, opened a new log
I20260810 21:08:38.257325 14047 ts_tablet_manager.cc:1397] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 21:08:38.259635 14047 raft_consensus.cc:348] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b34480143d044cb291384d4cc8ce282e" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43739 } } peers { permanent_uuid: "e6f245141a684c47a1676173cb39af3d" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 34391 } } peers { permanent_uuid: "b3b8afb689f54f599b025e2089d48f11" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46567 } }
I20260810 21:08:38.259768 14047 raft_consensus.cc:374] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:38.259790 14047 raft_consensus.cc:729] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3b8afb689f54f599b025e2089d48f11, State: Initialized, Role: FOLLOWER
I20260810 21:08:38.259912 14047 consensus_queue.cc:260] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b34480143d044cb291384d4cc8ce282e" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43739 } } peers { permanent_uuid: "e6f245141a684c47a1676173cb39af3d" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 34391 } } peers { permanent_uuid: "b3b8afb689f54f599b025e2089d48f11" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46567 } }
I20260810 21:08:38.260212 14047 ts_tablet_manager.cc:1428] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:08:38.260251 13811 heartbeater.cc:503] Master 127.15.37.62:46283 was elected leader, sending a full tablet report...
I20260810 21:08:38.271311 14054 raft_consensus.cc:482] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:08:38.271453 14054 raft_consensus.cc:504] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b34480143d044cb291384d4cc8ce282e" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43739 } } peers { permanent_uuid: "e6f245141a684c47a1676173cb39af3d" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 34391 } } peers { permanent_uuid: "b3b8afb689f54f599b025e2089d48f11" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46567 } }
I20260810 21:08:38.271929 14054 leader_election.cc:288] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b34480143d044cb291384d4cc8ce282e (127.15.37.1:43739), e6f245141a684c47a1676173cb39af3d (127.15.37.3:34391)
I20260810 21:08:38.274905 14040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.272205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:54863 (local address 127.15.37.3:34391)
0810 21:08:38.272261 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:38.272263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:38.272275 (+ 12us) server_negotiation.cc:407] Connection header received
0810 21:08:38.272313 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:38.272313 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:38.272324 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:38.272427 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:38.272652 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.273151 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.274150 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.274532 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.274618 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.274631 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:38.274781 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 21:08:38.274824 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 21:08:38.274909 13813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.272098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:34391 (local address 127.15.37.2:54863)
0810 21:08:38.272179 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:38.272193 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:38.272240 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:38.272434 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:38.272436 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:38.272437 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:38.272564 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.272567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.273247 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.273248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.274042 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.274045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.274621 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.274622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.274700 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.274703 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:08:38.274774 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 21:08:38.274823 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260810 21:08:38.275030 14055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.272154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:43739 (local address 127.15.37.2:37197)
0810 21:08:38.272356 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:38.272367 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:38.272436 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:38.272631 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:38.272632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:38.272634 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:38.272713 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.272715 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.273383 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.273384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.274153 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:38.274155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.274720 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.274721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:38.274803 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.274807 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:08:38.274882 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 21:08:38.274924 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":2,"thread_start_us":147,"threads_started":1}
I20260810 21:08:38.275012 14041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.272242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:37197 (local address 127.15.37.1:43739)
0810 21:08:38.272291 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:38.272293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:38.272428 (+ 135us) server_negotiation.cc:407] Connection header received
0810 21:08:38.272529 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:38.272530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:38.272544 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:38.272627 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:38.272801 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.273287 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.274254 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.274631 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.274719 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.274730 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:38.274892 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 21:08:38.274938 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 21:08:38.275434 13515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "815d8312f0814db1b05b3c7d65a9d165" candidate_uuid: "b3b8afb689f54f599b025e2089d48f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b34480143d044cb291384d4cc8ce282e" is_pre_election: true
I20260810 21:08:38.275470 13956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "815d8312f0814db1b05b3c7d65a9d165" candidate_uuid: "b3b8afb689f54f599b025e2089d48f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f245141a684c47a1676173cb39af3d" is_pre_election: true
I20260810 21:08:38.275624 13515 raft_consensus.cc:2454] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b8afb689f54f599b025e2089d48f11 in term 0.
I20260810 21:08:38.275624 13956 raft_consensus.cc:2454] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3b8afb689f54f599b025e2089d48f11 in term 0.
I20260810 21:08:38.275935 13639 leader_election.cc:302] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b34480143d044cb291384d4cc8ce282e, b3b8afb689f54f599b025e2089d48f11; no voters:
I20260810 21:08:38.276146 14054 raft_consensus.cc:2781] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:08:38.276249 14054 raft_consensus.cc:482] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:08:38.276289 14054 raft_consensus.cc:3037] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:38.277148 14054 raft_consensus.cc:504] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b34480143d044cb291384d4cc8ce282e" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43739 } } peers { permanent_uuid: "e6f245141a684c47a1676173cb39af3d" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 34391 } } peers { permanent_uuid: "b3b8afb689f54f599b025e2089d48f11" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46567 } }
I20260810 21:08:38.277334 14054 leader_election.cc:288] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [CANDIDATE]: Term 1 election: Requested vote from peers b34480143d044cb291384d4cc8ce282e (127.15.37.1:43739), e6f245141a684c47a1676173cb39af3d (127.15.37.3:34391)
I20260810 21:08:38.277621 13515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "815d8312f0814db1b05b3c7d65a9d165" candidate_uuid: "b3b8afb689f54f599b025e2089d48f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b34480143d044cb291384d4cc8ce282e"
I20260810 21:08:38.277731 13956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "815d8312f0814db1b05b3c7d65a9d165" candidate_uuid: "b3b8afb689f54f599b025e2089d48f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6f245141a684c47a1676173cb39af3d"
I20260810 21:08:38.277781 13515 raft_consensus.cc:3037] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:38.277855 13956 raft_consensus.cc:3037] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:38.279009 13956 raft_consensus.cc:2454] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b8afb689f54f599b025e2089d48f11 in term 1.
I20260810 21:08:38.279021 13515 raft_consensus.cc:2454] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3b8afb689f54f599b025e2089d48f11 in term 1.
I20260810 21:08:38.279218 13638 leader_election.cc:302] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3b8afb689f54f599b025e2089d48f11, e6f245141a684c47a1676173cb39af3d; no voters:
I20260810 21:08:38.279381 14054 raft_consensus.cc:2781] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:38.279757 14054 raft_consensus.cc:686] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [term 1 LEADER]: Becoming Leader. State: Replica: b3b8afb689f54f599b025e2089d48f11, State: Running, Role: LEADER
I20260810 21:08:38.279910 14054 consensus_queue.cc:237] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b34480143d044cb291384d4cc8ce282e" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43739 } } peers { permanent_uuid: "e6f245141a684c47a1676173cb39af3d" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 34391 } } peers { permanent_uuid: "b3b8afb689f54f599b025e2089d48f11" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46567 } }
I20260810 21:08:38.280958 13261 catalog_manager.cc:5495] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3b8afb689f54f599b025e2089d48f11 (127.15.37.2). New cstate: current_term: 1 leader_uuid: "b3b8afb689f54f599b025e2089d48f11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b34480143d044cb291384d4cc8ce282e" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6f245141a684c47a1676173cb39af3d" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 34391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3b8afb689f54f599b025e2089d48f11" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 46567 } health_report { overall_health: HEALTHY } } }
I20260810 21:08:38.293668 14038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.290910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39582 (local address 127.15.37.2:46567)
0810 21:08:38.290983 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:38.290985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:38.291004 (+ 19us) server_negotiation.cc:407] Connection header received
0810 21:08:38.291090 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:38.291091 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:38.291114 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:38.291185 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:08:38.291316 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.291875 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.292810 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:38.293025 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:38.293085 (+ 60us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:38.293268 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:08:38.293372 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:08:38.293481 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:38.293505 (+ 24us) server_negotiation.cc:299] Negotiation successful
0810 21:08:38.293517 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 21:08:38.295825 13956 raft_consensus.cc:1261] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d [term 1 FOLLOWER]: Refusing update from remote peer b3b8afb689f54f599b025e2089d48f11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:08:38.295825 13515 raft_consensus.cc:1261] T 815d8312f0814db1b05b3c7d65a9d165 P b34480143d044cb291384d4cc8ce282e [term 1 FOLLOWER]: Refusing update from remote peer b3b8afb689f54f599b025e2089d48f11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:08:38.296239 14056 consensus_queue.cc:1035] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6f245141a684c47a1676173cb39af3d" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 34391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:08:38.296409 14054 consensus_queue.cc:1035] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b34480143d044cb291384d4cc8ce282e" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 43739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:08:38.299451 14060 mvcc.cc:205] Tried to move back new op lower bound from 7317078500536700928 to 7317078500475383808. Current Snapshot: MvccSnapshot[applied={T|T < 7317078500536700928}]
I20260810 21:08:38.299794 14063 mvcc.cc:205] Tried to move back new op lower bound from 7317078500536700928 to 7317078500475383808. Current Snapshot: MvccSnapshot[applied={T|T < 7317078500536700928}]
I20260810 21:08:38.300523 14064 mvcc.cc:205] Tried to move back new op lower bound from 7317078500536700928 to 7317078500475383808. Current Snapshot: MvccSnapshot[applied={T|T < 7317078500536700928 or (T in {7317078500536700928})}]
I20260810 21:08:38.302350 13262 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:08:38.302464 13262 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:08:38.303323 13262 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f004e1c40cd845409702ebbb2b98f186: Sending DeleteTablet for 3 replicas of tablet 815d8312f0814db1b05b3c7d65a9d165
I20260810 21:08:38.303715 13928 tablet_service.cc:1514] Processing DeleteTablet for tablet 815d8312f0814db1b05b3c7d65a9d165 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:38 UTC) from {username='slave'} at 127.0.0.1:41036
I20260810 21:08:38.303802 13708 tablet_service.cc:1514] Processing DeleteTablet for tablet 815d8312f0814db1b05b3c7d65a9d165 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:38 UTC) from {username='slave'} at 127.0.0.1:39570
I20260810 21:08:38.303791 13482 tablet_service.cc:1514] Processing DeleteTablet for tablet 815d8312f0814db1b05b3c7d65a9d165 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:38 UTC) from {username='slave'} at 127.0.0.1:33552
I20260810 21:08:38.304035 14075 tablet_replica.cc:330] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11: stopping tablet replica
I20260810 21:08:38.304138 14075 raft_consensus.cc:2229] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:08:38.304279 14075 raft_consensus.cc:2258] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:08:38.304420 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 13372
I20260810 21:08:38.307857 14075 ts_tablet_manager.cc:1905] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:08:38.309882 14075 ts_tablet_manager.cc:1918] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:08:38.309976 14075 log.cc:1196] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/815d8312f0814db1b05b3c7d65a9d165
I20260810 21:08:38.310211 14075 ts_tablet_manager.cc:1939] T 815d8312f0814db1b05b3c7d65a9d165 P b3b8afb689f54f599b025e2089d48f11: Deleting consensus metadata
I20260810 21:08:38.310703 14074 tablet_replica.cc:330] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d: stopping tablet replica
I20260810 21:08:38.310858 14074 raft_consensus.cc:2229] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:08:38.310985 14074 raft_consensus.cc:2258] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:08:38.312147 14074 ts_tablet_manager.cc:1905] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:08:38.313992 14074 ts_tablet_manager.cc:1918] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:08:38.314067 14074 log.cc:1196] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/815d8312f0814db1b05b3c7d65a9d165
I20260810 21:08:38.314296 14074 ts_tablet_manager.cc:1939] T 815d8312f0814db1b05b3c7d65a9d165 P e6f245141a684c47a1676173cb39af3d: Deleting consensus metadata
I20260810 21:08:38.314477 13242 catalog_manager.cc:4841] TS b3b8afb689f54f599b025e2089d48f11 (127.15.37.2:46567): tablet 815d8312f0814db1b05b3c7d65a9d165 (table test-table [id=736d299bf07e432a9d2da4f8fdf7c9ea]) successfully deleted
I20260810 21:08:38.318943 13243 catalog_manager.cc:4841] TS e6f245141a684c47a1676173cb39af3d (127.15.37.3:34391): tablet 815d8312f0814db1b05b3c7d65a9d165 (table test-table [id=736d299bf07e432a9d2da4f8fdf7c9ea]) successfully deleted
W20260810 21:08:38.325227 13244 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:43739 (error 108)
I20260810 21:08:38.325909 14031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:38.325737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:43739 (local address 127.0.0.1:33564)
0810 21:08:38.325809 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:38.325864 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:43739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 21:08:38.326002 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 13606
W20260810 21:08:38.340180 13244 catalog_manager.cc:4584] TS b34480143d044cb291384d4cc8ce282e (127.15.37.1:43739): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 815d8312f0814db1b05b3c7d65a9d165: Network error: Client connection negotiation failed: client connection to 127.15.37.1:43739: connect: Connection refused (error 111)
I20260810 21:08:38.345386 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 13817
I20260810 21:08:38.356761 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 13213
2026-08-10T21:08:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (804 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:38 dist-test-slave-jq4t krb5kdc[14086](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:38 dist-test-slave-jq4t krb5kdc[14086](info): set up 2 sockets
Aug 10 21:08:38 dist-test-slave-jq4t krb5kdc[14086](info): commencing operation
krb5kdc: starting...
W20260810 21:08:39.671039 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.280s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:39 dist-test-slave-jq4t krb5kdc[14086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:08:39.808336 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:44235
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:41343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:44235
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:39.901607 14105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:39.902140 14105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:39.902184 14105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:39.904778 14105 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:39.904927 14105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:39.904953 14105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:39.904978 14105 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:39.904997 14105 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:39.908521 14105 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:41343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:44235
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:44235
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:39.909004 14105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:39.909426 14105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:39.916244 14111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:39.916244 14112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:39.916244 14115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:39.916702 14105 server_base.cc:1034] running on GCE node
I20260810 21:08:39.917054 14105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:39.917529 14105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:39.918700 14105 hybrid_clock.cc:648] HybridClock initialized: now 1786396119918674 us; error 53 us; skew 500 ppm
Aug 10 21:08:39 dist-test-slave-jq4t krb5kdc[14086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396119, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:39.921595 14105 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:08:39.922150 14105 webserver.cc:460] Webserver started at http://127.15.37.62:35701/ using document root <none> and password file <none>
I20260810 21:08:39.922435 14105 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:39.922484 14105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:39.922672 14105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:39.923866 14105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "90cd31a223034cb38565edb7635298f7"
format_stamp: "Formatted at 2026-08-10 21:08:39 on dist-test-slave-jq4t"
server_key: "efe502eb4f49d7b821738a8570b6a459"
server_key_iv: "c4a75fde51644a133479608d312fdb6c"
server_key_version: "encryptionkey@0"
I20260810 21:08:39.924273 14105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "90cd31a223034cb38565edb7635298f7"
format_stamp: "Formatted at 2026-08-10 21:08:39 on dist-test-slave-jq4t"
server_key: "efe502eb4f49d7b821738a8570b6a459"
server_key_iv: "c4a75fde51644a133479608d312fdb6c"
server_key_version: "encryptionkey@0"
I20260810 21:08:39.925894 14105 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:39.926725 14123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:39.926937 14105 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:39.927042 14105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "90cd31a223034cb38565edb7635298f7"
format_stamp: "Formatted at 2026-08-10 21:08:39 on dist-test-slave-jq4t"
server_key: "efe502eb4f49d7b821738a8570b6a459"
server_key_iv: "c4a75fde51644a133479608d312fdb6c"
server_key_version: "encryptionkey@0"
I20260810 21:08:39.927109 14105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:39.943656 14105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:39.946508 14105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:39.946648 14105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:39.951542 14105 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:44235
I20260810 21:08:39.951710 14201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:44235 every 8 connection(s)
I20260810 21:08:39.952289 14105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:39.953441 14202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:39.955225 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 14105
I20260810 21:08:39.955355 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:39.955614 15508 external_mini_cluster.cc:1428] Setting key c5cf28c16563fd920b59a0af5a9c8e73
I20260810 21:08:39.956523 14202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7: Bootstrap starting.
I20260810 21:08:39.957337 14202 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:39.957724 14202 log.cc:824] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:39.958568 14202 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7: No bootstrap required, opened a new log
I20260810 21:08:39.961115 14202 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90cd31a223034cb38565edb7635298f7" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44235 } }
I20260810 21:08:39.961334 14202 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:39.961385 14202 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90cd31a223034cb38565edb7635298f7, State: Initialized, Role: FOLLOWER
I20260810 21:08:39.961525 14202 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90cd31a223034cb38565edb7635298f7" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44235 } }
I20260810 21:08:39.961633 14202 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:39.961673 14202 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:39.961726 14202 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:39.962584 14202 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90cd31a223034cb38565edb7635298f7" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44235 } }
I20260810 21:08:39.962693 14202 leader_election.cc:302] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90cd31a223034cb38565edb7635298f7; no voters:
I20260810 21:08:39.962954 14202 leader_election.cc:288] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:39.962991 14212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:39.963153 14212 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [term 1 LEADER]: Becoming Leader. State: Replica: 90cd31a223034cb38565edb7635298f7, State: Running, Role: LEADER
I20260810 21:08:39.963243 14212 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90cd31a223034cb38565edb7635298f7" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44235 } }
I20260810 21:08:39.963277 14202 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:39.963594 14212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90cd31a223034cb38565edb7635298f7. Latest consensus state: current_term: 1 leader_uuid: "90cd31a223034cb38565edb7635298f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90cd31a223034cb38565edb7635298f7" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44235 } } }
I20260810 21:08:39.963747 14212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:39.963610 14215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90cd31a223034cb38565edb7635298f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90cd31a223034cb38565edb7635298f7" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44235 } } }
I20260810 21:08:39.963922 14215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7 [sys.catalog]: This master's current role is: LEADER
Aug 10 21:08:39 dist-test-slave-jq4t krb5kdc[14086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
W20260810 21:08:39.965852 14240 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:08:39.965919 14240 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:08:39.965979 14224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:39.966193 14224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:39.968084 14224 catalog_manager.cc:1347] Generated new cluster ID: e107ac58505b425e979b4728f4f55650
I20260810 21:08:39.968150 14224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:08:39.969121 14208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:39.956390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33754 (local address 127.15.37.62:44235)
0810 21:08:39.956689 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:39.956698 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:39.956732 (+ 34us) server_negotiation.cc:407] Connection header received
0810 21:08:39.957427 (+ 695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:39.957437 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:39.957514 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:39.957688 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:39.958409 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:39.959890 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:39.960870 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:39.961534 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:39.961673 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:39.964962 (+ 3289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:39.964967 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:39.964967 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:39.964979 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:39.967207 (+ 2228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:39.967711 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:39.967715 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:39.967715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:39.967825 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:39.968071 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:39.968072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:39.968072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:39.968416 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:39.968595 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:39.968723 (+ 128us) server_negotiation.cc:299] Negotiation successful
0810 21:08:39.968900 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":165,"threads_started":1}
I20260810 21:08:39.986729 14224 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:39.987530 14224 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:40.001688 14224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7: Generated new TSK 0
I20260810 21:08:40.001982 14224 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.15.37.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
Entry for principal kudu/127.15.37.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab.
I20260810 21:08:40.035300 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44235
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:41343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:40.127351 14246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:40.127602 14246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:40.127630 14246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:40.128829 14246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:40.128875 14246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:40.128904 14246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:08:40.130558 14246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:41343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.1.keytab
--principal=kudu/127.15.37.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:40.130803 14246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:40.131070 14246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:40.136641 14253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:40.136653 14255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:40.136665 14252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:40.136973 14246 server_base.cc:1034] running on GCE node
I20260810 21:08:40.137154 14246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:40.137360 14246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:40.138532 14246 hybrid_clock.cc:648] HybridClock initialized: now 1786396120138526 us; error 45 us; skew 500 ppm
Aug 10 21:08:40 dist-test-slave-jq4t krb5kdc[14086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396120, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:40.141204 14246 init.cc:377] Logged in from keytab as kudu/127.15.37.1@KRBTEST.COM (short username kudu)
I20260810 21:08:40.141638 14246 webserver.cc:460] Webserver started at http://127.15.37.1:36701/ using document root <none> and password file <none>
I20260810 21:08:40.141831 14246 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:40.141883 14246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:40.141980 14246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:40.143052 14246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "7bd0a887b42e4619a6e6656ec76d3f56"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "7ef08d81736cf97038d34d1260a83ba7"
server_key_iv: "648168758809b264f42195f8fffca6ca"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.143370 14246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "7bd0a887b42e4619a6e6656ec76d3f56"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "7ef08d81736cf97038d34d1260a83ba7"
server_key_iv: "648168758809b264f42195f8fffca6ca"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.144788 14246 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 21:08:40.145599 14273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:40.145792 14246 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:40.145886 14246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "7bd0a887b42e4619a6e6656ec76d3f56"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "7ef08d81736cf97038d34d1260a83ba7"
server_key_iv: "648168758809b264f42195f8fffca6ca"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.145951 14246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:40.157109 14246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:40.159633 14246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:40.159778 14246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:40.160014 14246 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:40.160372 14246 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:40.160411 14246 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:40.160463 14246 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:40.160516 14246 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:40.167161 14246 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:42419
I20260810 21:08:40.167264 14437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:42419 every 8 connection(s)
I20260810 21:08:40.167639 14246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:08:40.172185 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 14246
I20260810 21:08:40.172359 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:08:40.172598 15508 external_mini_cluster.cc:1428] Setting key 54daa7ab5946d35a12f967384a82118d
Aug 10 21:08:40 dist-test-slave-jq4t krb5kdc[14086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396120, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.1@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:08:40.179092 14208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.168534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:60823 (local address 127.15.37.62:44235)
0810 21:08:40.168596 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:40.168598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:40.168848 (+ 250us) server_negotiation.cc:407] Connection header received
0810 21:08:40.169377 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:40.169379 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:40.169391 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:40.169446 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:40.170508 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.171090 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.172261 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.172653 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.172733 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.175496 (+ 2763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:40.175498 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:40.175499 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:40.175510 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:40.177442 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:40.177960 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:40.177961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:40.177962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:40.178033 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:40.178321 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:40.178323 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:40.178323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:40.178465 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:40.178542 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:40.178868 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 21:08:40.178991 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 21:08:40.179294 14442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.168466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44235 (local address 127.15.37.1:60823)
0810 21:08:40.168703 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:40.168746 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:40.169270 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:40.169505 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:40.169508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:40.170157 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:40.170377 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.170382 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.171222 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.171223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.172147 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.172150 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.172751 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.172752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.172941 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.173611 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:08:40.173624 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:40.175382 (+ 1758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:40.177563 (+ 2181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:40.177574 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:40.177577 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:40.177848 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:40.178106 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:40.178107 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:40.178107 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:40.178241 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:40.178544 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:40.178553 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:40.178719 (+ 166us) client_negotiation.cc:769] Sending connection context
0810 21:08:40.178831 (+ 112us) client_negotiation.cc:240] Negotiation successful
0810 21:08:40.179030 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":143,"threads_started":1}
I20260810 21:08:40.180060 14438 heartbeater.cc:347] Connected to a master server at 127.15.37.62:44235
I20260810 21:08:40.180207 14438 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:40.180428 14438 heartbeater.cc:511] Master 127.15.37.62:44235 requested a full tablet report, sending...
I20260810 21:08:40.181180 14148 ts_manager.cc:194] Registered new tserver with Master: 7bd0a887b42e4619a6e6656ec76d3f56 (127.15.37.1:42419)
I20260810 21:08:40.182279 14148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.1@KRBTEST.COM'} at 127.15.37.1:60823
WARNING: no policy specified for kudu/127.15.37.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
Entry for principal kudu/127.15.37.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab.
I20260810 21:08:40.203956 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44235
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:41343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:40.293442 14445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:40.293727 14445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:40.293773 14445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:40.295053 14445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:40.295110 14445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:40.295140 14445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:08:40.296736 14445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:41343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.2.keytab
--principal=kudu/127.15.37.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:40.296960 14445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:40.297181 14445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:40.302889 14457 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:40.302850 14453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:40.302865 14455 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:40.302908 14445 server_base.cc:1034] running on GCE node
I20260810 21:08:40.303309 14445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:40.303582 14445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:40.304728 14445 hybrid_clock.cc:648] HybridClock initialized: now 1786396120304705 us; error 41 us; skew 500 ppm
Aug 10 21:08:40 dist-test-slave-jq4t krb5kdc[14086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396120, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:40.307510 14445 init.cc:377] Logged in from keytab as kudu/127.15.37.2@KRBTEST.COM (short username kudu)
I20260810 21:08:40.308228 14445 webserver.cc:460] Webserver started at http://127.15.37.2:45215/ using document root <none> and password file <none>
I20260810 21:08:40.308614 14445 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:40.308670 14445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:40.308831 14445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:40.310014 14445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "1fab269c9f934b89afb12e558c8e74bb"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "3e7b9c8de69a4877c2f3e7f73d4f2594"
server_key_iv: "e1f3f167843142dccf55a91fb69e2a06"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.310413 14445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "1fab269c9f934b89afb12e558c8e74bb"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "3e7b9c8de69a4877c2f3e7f73d4f2594"
server_key_iv: "e1f3f167843142dccf55a91fb69e2a06"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.311858 14445 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:08:40.312784 14465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:40.312990 14445 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:40.313100 14445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "1fab269c9f934b89afb12e558c8e74bb"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "3e7b9c8de69a4877c2f3e7f73d4f2594"
server_key_iv: "e1f3f167843142dccf55a91fb69e2a06"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.313184 14445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:40.324898 14445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:40.327158 14445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:40.327338 14445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:40.327605 14445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:40.327951 14445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:40.328009 14445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:40.328081 14445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:40.328114 14445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:40.335299 14445 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:38757
I20260810 21:08:40.335404 14661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:38757 every 8 connection(s)
I20260810 21:08:40.335783 14445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:08:40.340739 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 14445
I20260810 21:08:40.340899 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:08:40.341133 15508 external_mini_cluster.cc:1428] Setting key 1451b6a7ccb0625de8d9cddd17650fbe
Aug 10 21:08:40 dist-test-slave-jq4t krb5kdc[14086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396120, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.2@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:08:40.350647 14208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.336742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:37737 (local address 127.15.37.62:44235)
0810 21:08:40.336829 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:40.336832 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:40.337083 (+ 251us) server_negotiation.cc:407] Connection header received
0810 21:08:40.337644 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:40.337645 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:40.337657 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:40.337715 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:40.338741 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.339367 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.340450 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.340763 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.340839 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.347070 (+ 6231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:40.347073 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:40.347074 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:40.347084 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:40.349021 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:40.349497 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:40.349499 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:40.349499 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:40.349570 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:40.349842 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:40.349843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:40.349843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:40.350035 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:40.350118 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:40.350431 (+ 313us) server_negotiation.cc:299] Negotiation successful
0810 21:08:40.350536 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260810 21:08:40.350752 14671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.336717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44235 (local address 127.15.37.2:37737)
0810 21:08:40.336946 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:40.336989 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:40.337532 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:40.337775 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:40.337778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:40.338413 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:40.338631 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.338636 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.339472 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.339473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.340362 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.340365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.340869 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.340870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.341054 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.344643 (+ 3589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:08:40.344655 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:40.346916 (+ 2261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:40.349123 (+ 2207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:40.349135 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:40.349138 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:40.349406 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:40.349646 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:40.349647 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:40.349647 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:40.349770 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:40.350116 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:40.350123 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:40.350283 (+ 160us) client_negotiation.cc:769] Sending connection context
0810 21:08:40.350377 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 21:08:40.350531 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":114,"threads_started":1}
I20260810 21:08:40.351442 14668 heartbeater.cc:347] Connected to a master server at 127.15.37.62:44235
I20260810 21:08:40.351570 14668 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.15.37.3@KRBTEST.COM; defaulting to no policy
I20260810 21:08:40.351778 14668 heartbeater.cc:511] Master 127.15.37.62:44235 requested a full tablet report, sending...
I20260810 21:08:40.352290 14148 ts_manager.cc:194] Registered new tserver with Master: 1fab269c9f934b89afb12e558c8e74bb (127.15.37.2:38757)
I20260810 21:08:40.352762 14148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.2@KRBTEST.COM'} at 127.15.37.2:37737
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
Entry for principal kudu/127.15.37.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab.
I20260810 21:08:40.373140 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44235
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:41343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:40.462738 14677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:40.462967 14677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:40.462996 14677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:40.464437 14677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:40.464538 14677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:40.464573 14677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:08:40.466295 14677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:41343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.3.keytab
--principal=kudu/127.15.37.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:40.466542 14677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:40.466830 14677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:40.472589 14690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:40.472582 14691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:40.472635 14677 server_base.cc:1034] running on GCE node
W20260810 21:08:40.472582 14695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:40.473078 14677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:40.473369 14677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:40.474524 14677 hybrid_clock.cc:648] HybridClock initialized: now 1786396120474516 us; error 37 us; skew 500 ppm
Aug 10 21:08:40 dist-test-slave-jq4t krb5kdc[14086](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396120, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:40.477514 14677 init.cc:377] Logged in from keytab as kudu/127.15.37.3@KRBTEST.COM (short username kudu)
I20260810 21:08:40.478055 14677 webserver.cc:460] Webserver started at http://127.15.37.3:34267/ using document root <none> and password file <none>
I20260810 21:08:40.478298 14677 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:40.478348 14677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:40.478464 14677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:40.479636 14677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "373e7996e3cd4e528a3072832db0a32c"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "97de0d07923e8cb1c4287286d463b367"
server_key_iv: "638718f6175c7019c04646e51d059a4c"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.479977 14677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "373e7996e3cd4e528a3072832db0a32c"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "97de0d07923e8cb1c4287286d463b367"
server_key_iv: "638718f6175c7019c04646e51d059a4c"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.481619 14677 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:08:40.482456 14708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:40.482672 14677 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:08:40.482775 14677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "373e7996e3cd4e528a3072832db0a32c"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "97de0d07923e8cb1c4287286d463b367"
server_key_iv: "638718f6175c7019c04646e51d059a4c"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.482847 14677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:40.496281 14677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:40.499100 14677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:40.499243 14677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:40.499501 14677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:40.499905 14677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:40.499951 14677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:40.499977 14677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:40.499990 14677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:40.506747 14677 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:36969
I20260810 21:08:40.506839 14893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:36969 every 8 connection(s)
I20260810 21:08:40.507230 14677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:08:40.510011 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 14677
I20260810 21:08:40.510113 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:08:40.510321 15508 external_mini_cluster.cc:1428] Setting key bdf4272db814a69bee0258acfe49994d
Aug 10 21:08:40 dist-test-slave-jq4t krb5kdc[14086](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396120, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.3@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:08:40.520141 14208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.508057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:34189 (local address 127.15.37.62:44235)
0810 21:08:40.508135 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:40.508136 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:40.508342 (+ 206us) server_negotiation.cc:407] Connection header received
0810 21:08:40.509013 (+ 671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:40.509014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:40.509027 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:40.509098 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:40.510253 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.510986 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.512823 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.513097 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.513176 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.516383 (+ 3207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:40.516385 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:40.516386 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:40.516395 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:40.518467 (+ 2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:40.518935 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:40.518936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:40.518937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:40.519010 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:40.519325 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:40.519326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:40.519326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:40.519479 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:40.519564 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:40.519923 (+ 359us) server_negotiation.cc:299] Negotiation successful
0810 21:08:40.520035 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 21:08:40.520681 14899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.508012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44235 (local address 127.15.37.3:34189)
0810 21:08:40.508201 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:40.508249 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:40.508899 (+ 650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:40.509186 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:40.509189 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:40.509853 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:40.510107 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.510114 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.511210 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.511211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.512700 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.512705 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.513219 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.513221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.513391 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.514026 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:08:40.514036 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:40.516265 (+ 2229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:40.518564 (+ 2299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:40.518575 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:40.518578 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:40.518841 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:40.519083 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:08:40.519084 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:08:40.519085 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:08:40.519249 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:08:40.519554 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:40.519563 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:40.519738 (+ 175us) client_negotiation.cc:769] Sending connection context
0810 21:08:40.519862 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 21:08:40.520085 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":104,"threads_started":1}
I20260810 21:08:40.523051 14895 heartbeater.cc:347] Connected to a master server at 127.15.37.62:44235
I20260810 21:08:40.523227 14895 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:40.523476 14895 heartbeater.cc:511] Master 127.15.37.62:44235 requested a full tablet report, sending...
I20260810 21:08:40.523960 14148 ts_manager.cc:194] Registered new tserver with Master: 373e7996e3cd4e528a3072832db0a32c (127.15.37.3:36969)
I20260810 21:08:40.524574 14148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.37.3@KRBTEST.COM'} at 127.15.37.3:34189
I20260810 21:08:40.533588 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:08:40.548357 14208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.540271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33764 (local address 127.15.37.62:44235)
0810 21:08:40.540323 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:40.540326 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:40.540408 (+ 82us) server_negotiation.cc:407] Connection header received
0810 21:08:40.540532 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:40.540533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:40.540546 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:40.540607 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:40.541525 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.542296 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.543431 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.543655 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.543742 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.545178 (+ 1436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:40.545180 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:40.545180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:40.545189 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:40.546969 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:40.547325 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:40.547326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:40.547327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:40.547396 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:40.547605 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:40.547606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:40.547606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:40.547876 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:40.547995 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:40.548140 (+ 145us) server_negotiation.cc:299] Negotiation successful
0810 21:08:40.548234 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 21:08:40.550541 14148 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33764:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:08:40.552215 14148 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:08:40.562745 14914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.557004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:42419 (local address 127.0.0.1:59074)
0810 21:08:40.557186 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:40.557235 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:40.557313 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:40.558504 (+ 1191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:40.558505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:40.558508 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:40.558585 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.558587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.560130 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.560131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.561232 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.561234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.562335 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.562336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.562439 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.562455 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 21:08:40.562547 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 21:08:40.562604 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"spinlock_wait_cycles":896,"thread_start_us":114,"threads_started":1}
I20260810 21:08:40.562783 14915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.557138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59074 (local address 127.15.37.1:42419)
0810 21:08:40.558292 (+ 1154us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:40.558297 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:40.558308 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:08:40.558359 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:40.558361 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:40.558379 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:40.558471 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:40.558657 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.559994 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.561319 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.562233 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.562329 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.562410 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:40.562604 (+ 194us) server_negotiation.cc:299] Negotiation successful
0810 21:08:40.562672 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1109,"thread_start_us":108,"threads_started":1}
I20260810 21:08:40.564096 14913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.557007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:36969 (local address 127.0.0.1:50638)
0810 21:08:40.557343 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:40.557355 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:40.557415 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:40.558119 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:40.558120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:40.558122 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:40.558183 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.558185 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.559524 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.559525 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.561185 (+ 1660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.561189 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.563824 (+ 2635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.563825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.563913 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.563918 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:08:40.563964 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 21:08:40.564013 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":48,"thread_start_us":52,"threads_started":1}
I20260810 21:08:40.564181 14341 tablet_service.cc:1467] Processing CreateTablet for tablet 3b688eac22ff40809786aeabfe0048b3 (DEFAULT_TABLE table=test-table [id=dc58d760a1e246319d652b8e147cff2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:40.564551 14916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.557243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:38757 (local address 127.0.0.1:55224)
0810 21:08:40.557710 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:40.557722 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:40.557791 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:40.557989 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:40.557993 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:40.557996 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:40.558079 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.558081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.559723 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.559725 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.562053 (+ 2328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.562056 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.564271 (+ 2215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.564272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.564331 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.564335 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:08:40.564367 (+ 32us) client_negotiation.cc:240] Negotiation successful
0810 21:08:40.564420 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":1351,"thread_start_us":78,"threads_started":1}
I20260810 21:08:40.564738 14341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b688eac22ff40809786aeabfe0048b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:40.565207 14917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.557286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50638 (local address 127.15.37.3:36969)
0810 21:08:40.557948 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:40.557953 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:40.557966 (+ 13us) server_negotiation.cc:407] Connection header received
0810 21:08:40.558014 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:40.558017 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:40.558034 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:40.558125 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:40.558275 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.559397 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.562831 (+ 3434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.563688 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.563790 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.565015 (+ 1225us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:40.565056 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 21:08:40.565109 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603,"thread_start_us":93,"threads_started":1}
I20260810 21:08:40.565564 14918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.557502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55224 (local address 127.15.37.2:38757)
0810 21:08:40.557687 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:40.557693 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:40.557791 (+ 98us) server_negotiation.cc:407] Connection header received
0810 21:08:40.557857 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:40.557859 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:40.557874 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:40.557975 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:40.558175 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.559398 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.562160 (+ 2762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.564162 (+ 2002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.564669 (+ 507us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.564761 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:40.564792 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 21:08:40.564842 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":101,"threads_started":1}
I20260810 21:08:40.565915 14786 tablet_service.cc:1467] Processing CreateTablet for tablet 3b688eac22ff40809786aeabfe0048b3 (DEFAULT_TABLE table=test-table [id=dc58d760a1e246319d652b8e147cff2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:40.566190 14786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b688eac22ff40809786aeabfe0048b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:40.569172 14919 tablet_bootstrap.cc:492] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c: Bootstrap starting.
I20260810 21:08:40.569831 14920 tablet_bootstrap.cc:492] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56: Bootstrap starting.
I20260810 21:08:40.570067 14919 tablet_bootstrap.cc:654] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:40.570405 14544 tablet_service.cc:1467] Processing CreateTablet for tablet 3b688eac22ff40809786aeabfe0048b3 (DEFAULT_TABLE table=test-table [id=dc58d760a1e246319d652b8e147cff2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:40.570657 14920 tablet_bootstrap.cc:654] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:40.570804 14919 log.cc:824] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:40.570879 14544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b688eac22ff40809786aeabfe0048b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:40.571367 14920 log.cc:824] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:40.571807 14919 tablet_bootstrap.cc:492] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c: No bootstrap required, opened a new log
I20260810 21:08:40.571895 14919 ts_tablet_manager.cc:1397] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:08:40.572257 14920 tablet_bootstrap.cc:492] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56: No bootstrap required, opened a new log
I20260810 21:08:40.572342 14920 ts_tablet_manager.cc:1397] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:08:40.574294 14927 tablet_bootstrap.cc:492] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb: Bootstrap starting.
I20260810 21:08:40.574200 14919 raft_consensus.cc:348] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 42419 } } peers { permanent_uuid: "1fab269c9f934b89afb12e558c8e74bb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38757 } } peers { permanent_uuid: "373e7996e3cd4e528a3072832db0a32c" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 36969 } }
I20260810 21:08:40.574424 14919 raft_consensus.cc:374] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:40.574474 14919 raft_consensus.cc:729] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 373e7996e3cd4e528a3072832db0a32c, State: Initialized, Role: FOLLOWER
I20260810 21:08:40.574638 14919 consensus_queue.cc:260] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 42419 } } peers { permanent_uuid: "1fab269c9f934b89afb12e558c8e74bb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38757 } } peers { permanent_uuid: "373e7996e3cd4e528a3072832db0a32c" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 36969 } }
I20260810 21:08:40.574630 14920 raft_consensus.cc:348] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 42419 } } peers { permanent_uuid: "1fab269c9f934b89afb12e558c8e74bb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38757 } } peers { permanent_uuid: "373e7996e3cd4e528a3072832db0a32c" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 36969 } }
I20260810 21:08:40.574819 14920 raft_consensus.cc:374] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:40.574864 14920 raft_consensus.cc:729] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bd0a887b42e4619a6e6656ec76d3f56, State: Initialized, Role: FOLLOWER
I20260810 21:08:40.574978 14919 ts_tablet_manager.cc:1428] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:08:40.575009 14920 consensus_queue.cc:260] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 42419 } } peers { permanent_uuid: "1fab269c9f934b89afb12e558c8e74bb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38757 } } peers { permanent_uuid: "373e7996e3cd4e528a3072832db0a32c" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 36969 } }
I20260810 21:08:40.575126 14895 heartbeater.cc:503] Master 127.15.37.62:44235 was elected leader, sending a full tablet report...
I20260810 21:08:40.575253 14927 tablet_bootstrap.cc:654] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:40.575338 14920 ts_tablet_manager.cc:1428] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:08:40.575357 14438 heartbeater.cc:503] Master 127.15.37.62:44235 was elected leader, sending a full tablet report...
I20260810 21:08:40.576617 14927 log.cc:824] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:40.577581 14927 tablet_bootstrap.cc:492] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb: No bootstrap required, opened a new log
I20260810 21:08:40.577684 14927 ts_tablet_manager.cc:1397] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260810 21:08:40.579571 14927 raft_consensus.cc:348] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 42419 } } peers { permanent_uuid: "1fab269c9f934b89afb12e558c8e74bb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38757 } } peers { permanent_uuid: "373e7996e3cd4e528a3072832db0a32c" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 36969 } }
I20260810 21:08:40.579746 14927 raft_consensus.cc:374] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:40.579792 14927 raft_consensus.cc:729] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fab269c9f934b89afb12e558c8e74bb, State: Initialized, Role: FOLLOWER
I20260810 21:08:40.579932 14927 consensus_queue.cc:260] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 42419 } } peers { permanent_uuid: "1fab269c9f934b89afb12e558c8e74bb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38757 } } peers { permanent_uuid: "373e7996e3cd4e528a3072832db0a32c" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 36969 } }
I20260810 21:08:40.580258 14927 ts_tablet_manager.cc:1428] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 21:08:40.580343 14668 heartbeater.cc:503] Master 127.15.37.62:44235 was elected leader, sending a full tablet report...
I20260810 21:08:40.586359 14930 raft_consensus.cc:482] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 21:08:40.586422 14669 tablet.cc:2369] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:08:40.586529 14930 raft_consensus.cc:504] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 42419 } } peers { permanent_uuid: "1fab269c9f934b89afb12e558c8e74bb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38757 } } peers { permanent_uuid: "373e7996e3cd4e528a3072832db0a32c" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 36969 } }
I20260810 21:08:40.586992 14930 leader_election.cc:288] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fab269c9f934b89afb12e558c8e74bb (127.15.37.2:38757), 373e7996e3cd4e528a3072832db0a32c (127.15.37.3:36969)
I20260810 21:08:40.591230 14918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.587259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:46537 (local address 127.15.37.2:38757)
0810 21:08:40.587308 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:40.587310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:40.587704 (+ 394us) server_negotiation.cc:407] Connection header received
0810 21:08:40.587760 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:40.587761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:40.587773 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:40.587820 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:40.588038 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.588802 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.590217 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.590795 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.590880 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.590894 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:40.591109 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 21:08:40.591161 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 21:08:40.591261 14935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.587148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:38757 (local address 127.15.37.1:46537)
0810 21:08:40.587648 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:40.587658 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:40.587708 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:40.587866 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:40.587866 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:40.587868 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:40.587937 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.587939 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.588910 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.588911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.590137 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.590141 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.590912 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.590913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.591014 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.591021 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 21:08:40.591094 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 21:08:40.591150 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":311,"thread_start_us":123,"threads_started":1}
I20260810 21:08:40.591429 14917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.587252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:59617 (local address 127.15.37.3:36969)
0810 21:08:40.587301 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:40.587303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:40.587313 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:08:40.587343 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:40.587344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:40.587358 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:40.587421 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:40.587623 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.588603 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.590305 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.590916 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.590973 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.590982 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:40.591296 (+ 314us) server_negotiation.cc:299] Negotiation successful
0810 21:08:40.591343 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 21:08:40.591265 14442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.587140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:36969 (local address 127.15.37.1:59617)
0810 21:08:40.587194 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:40.587209 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:40.587260 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:40.587428 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:40.587429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:40.587431 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:40.587527 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.587530 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.588724 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.588725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.590205 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:40.590209 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.590985 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.590987 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:40.591088 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.591093 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:08:40.591145 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 21:08:40.591186 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260810 21:08:40.591755 14585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b688eac22ff40809786aeabfe0048b3" candidate_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fab269c9f934b89afb12e558c8e74bb" is_pre_election: true
I20260810 21:08:40.591962 14585 raft_consensus.cc:2454] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bd0a887b42e4619a6e6656ec76d3f56 in term 0.
I20260810 21:08:40.592000 14819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b688eac22ff40809786aeabfe0048b3" candidate_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373e7996e3cd4e528a3072832db0a32c" is_pre_election: true
I20260810 21:08:40.592146 14819 raft_consensus.cc:2454] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bd0a887b42e4619a6e6656ec76d3f56 in term 0.
I20260810 21:08:40.592242 14274 leader_election.cc:302] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fab269c9f934b89afb12e558c8e74bb, 7bd0a887b42e4619a6e6656ec76d3f56; no voters:
I20260810 21:08:40.592459 14930 raft_consensus.cc:2781] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:08:40.592562 14930 raft_consensus.cc:482] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:08:40.592587 14930 raft_consensus.cc:3037] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:40.593457 14930 raft_consensus.cc:504] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 42419 } } peers { permanent_uuid: "1fab269c9f934b89afb12e558c8e74bb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38757 } } peers { permanent_uuid: "373e7996e3cd4e528a3072832db0a32c" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 36969 } }
I20260810 21:08:40.593636 14930 leader_election.cc:288] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [CANDIDATE]: Term 1 election: Requested vote from peers 1fab269c9f934b89afb12e558c8e74bb (127.15.37.2:38757), 373e7996e3cd4e528a3072832db0a32c (127.15.37.3:36969)
I20260810 21:08:40.593796 14585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b688eac22ff40809786aeabfe0048b3" candidate_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fab269c9f934b89afb12e558c8e74bb"
I20260810 21:08:40.593843 14819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b688eac22ff40809786aeabfe0048b3" candidate_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "373e7996e3cd4e528a3072832db0a32c"
I20260810 21:08:40.593891 14585 raft_consensus.cc:3037] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:40.593958 14819 raft_consensus.cc:3037] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:40.594726 14819 raft_consensus.cc:2454] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bd0a887b42e4619a6e6656ec76d3f56 in term 1.
I20260810 21:08:40.594736 14585 raft_consensus.cc:2454] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bd0a887b42e4619a6e6656ec76d3f56 in term 1.
I20260810 21:08:40.594974 14277 leader_election.cc:302] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 373e7996e3cd4e528a3072832db0a32c, 7bd0a887b42e4619a6e6656ec76d3f56; no voters:
I20260810 21:08:40.595085 14930 raft_consensus.cc:2781] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:40.595278 14930 raft_consensus.cc:686] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [term 1 LEADER]: Becoming Leader. State: Replica: 7bd0a887b42e4619a6e6656ec76d3f56, State: Running, Role: LEADER
I20260810 21:08:40.595402 14930 consensus_queue.cc:237] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 42419 } } peers { permanent_uuid: "1fab269c9f934b89afb12e558c8e74bb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38757 } } peers { permanent_uuid: "373e7996e3cd4e528a3072832db0a32c" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 36969 } }
I20260810 21:08:40.596390 14146 catalog_manager.cc:5495] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bd0a887b42e4619a6e6656ec76d3f56 (127.15.37.1). New cstate: current_term: 1 leader_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bd0a887b42e4619a6e6656ec76d3f56" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 42419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fab269c9f934b89afb12e558c8e74bb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "373e7996e3cd4e528a3072832db0a32c" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 36969 } health_report { overall_health: UNKNOWN } } }
I20260810 21:08:40.608405 14915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.605653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59078 (local address 127.15.37.1:42419)
0810 21:08:40.605841 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:40.605843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:40.605854 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:08:40.605931 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:40.605932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:40.605958 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:40.606029 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:08:40.606202 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.606688 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.607582 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.607783 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.607840 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.608004 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:08:40.608122 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:08:40.608184 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:40.608267 (+ 83us) server_negotiation.cc:299] Negotiation successful
0810 21:08:40.608287 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
I20260810 21:08:40.610641 14585 raft_consensus.cc:1261] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb [term 1 FOLLOWER]: Refusing update from remote peer 7bd0a887b42e4619a6e6656ec76d3f56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:08:40.610641 14819 raft_consensus.cc:1261] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c [term 1 FOLLOWER]: Refusing update from remote peer 7bd0a887b42e4619a6e6656ec76d3f56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:08:40.611128 14930 consensus_queue.cc:1035] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fab269c9f934b89afb12e558c8e74bb" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 38757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:08:40.611334 14937 consensus_queue.cc:1035] T 3b688eac22ff40809786aeabfe0048b3 P 7bd0a887b42e4619a6e6656ec76d3f56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "373e7996e3cd4e528a3072832db0a32c" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 36969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:08:40.614847 14945 mvcc.cc:205] Tried to move back new op lower bound from 7317078510017736704 to 7317078509959565312. Current Snapshot: MvccSnapshot[applied={T|T < 7317078510017736704}]
I20260810 21:08:40.616539 14944 mvcc.cc:205] Tried to move back new op lower bound from 7317078510017736704 to 7317078509959565312. Current Snapshot: MvccSnapshot[applied={T|T < 7317078510017736704 or (T in {7317078510017736704})}]
I20260810 21:08:40.616858 14148 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:08:40.616953 14148 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:08:40.617966 14148 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 90cd31a223034cb38565edb7635298f7: Sending DeleteTablet for 3 replicas of tablet 3b688eac22ff40809786aeabfe0048b3
I20260810 21:08:40.618449 14786 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b688eac22ff40809786aeabfe0048b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:40 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:50638
I20260810 21:08:40.618512 14341 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b688eac22ff40809786aeabfe0048b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:40 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:59074
I20260810 21:08:40.618772 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 14246
I20260810 21:08:40.618809 14544 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b688eac22ff40809786aeabfe0048b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:40 UTC) from {username='kudu', principal='kudu/127.15.37.62@KRBTEST.COM'} at 127.0.0.1:55224
I20260810 21:08:40.628805 14960 tablet_replica.cc:330] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb: stopping tablet replica
I20260810 21:08:40.628983 14960 raft_consensus.cc:2229] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:08:40.629105 14960 raft_consensus.cc:2258] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:08:40.629585 14955 tablet_replica.cc:330] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c: stopping tablet replica
I20260810 21:08:40.629745 14955 raft_consensus.cc:2229] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:08:40.629768 14960 ts_tablet_manager.cc:1905] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:08:40.629871 14955 raft_consensus.cc:2258] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:08:40.630409 14955 ts_tablet_manager.cc:1905] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:08:40.631407 14960 ts_tablet_manager.cc:1918] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:08:40.631471 14960 log.cc:1196] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/3b688eac22ff40809786aeabfe0048b3
I20260810 21:08:40.631695 14960 ts_tablet_manager.cc:1939] T 3b688eac22ff40809786aeabfe0048b3 P 1fab269c9f934b89afb12e558c8e74bb: Deleting consensus metadata
I20260810 21:08:40.632233 14124 catalog_manager.cc:4841] TS 1fab269c9f934b89afb12e558c8e74bb (127.15.37.2:38757): tablet 3b688eac22ff40809786aeabfe0048b3 (table test-table [id=dc58d760a1e246319d652b8e147cff2a]) successfully deleted
I20260810 21:08:40.632876 14955 ts_tablet_manager.cc:1918] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:08:40.632990 14955 log.cc:1196] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/3b688eac22ff40809786aeabfe0048b3
I20260810 21:08:40.633384 14955 ts_tablet_manager.cc:1939] T 3b688eac22ff40809786aeabfe0048b3 P 373e7996e3cd4e528a3072832db0a32c: Deleting consensus metadata
I20260810 21:08:40.633956 14129 catalog_manager.cc:4841] TS 373e7996e3cd4e528a3072832db0a32c (127.15.37.3:36969): tablet 3b688eac22ff40809786aeabfe0048b3 (table test-table [id=dc58d760a1e246319d652b8e147cff2a]) successfully deleted
W20260810 21:08:40.639376 14124 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:42419 (error 108)
I20260810 21:08:40.639684 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 14445
I20260810 21:08:40.651660 14916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.651454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:42419 (local address 127.0.0.1:59092)
0810 21:08:40.651534 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:40.651611 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:42419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260810 21:08:40.651913 14124 catalog_manager.cc:4584] TS 7bd0a887b42e4619a6e6656ec76d3f56 (127.15.37.1:42419): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3b688eac22ff40809786aeabfe0048b3: Network error: Client connection negotiation failed: client connection to 127.15.37.1:42419: connect: Connection refused (error 111)
I20260810 21:08:40.656301 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 14677
I20260810 21:08:40.671118 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 14105
2026-08-10T21:08:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2311 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-10T21:08:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:40Z Disabled control of system clock
I20260810 21:08:40.711472 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:44955
--webserver_interface=127.15.37.62
--webserver_port=0
--builtin_ntp_servers=127.15.37.20:34523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:44955
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 21:08:40.798657 14968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:40.798919 14968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:40.798942 14968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:40.800088 14968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:40.800130 14968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:40.800144 14968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:40.800158 14968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:40.800169 14968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:40.801573 14968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:44955
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:44955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:40.801815 14968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:40.802098 14968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:40.807267 14977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:40.807271 14980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:40.807283 14985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:40.807497 14968 server_base.cc:1034] running on GCE node
I20260810 21:08:40.807854 14968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:40.808139 14968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:40.809293 14968 hybrid_clock.cc:648] HybridClock initialized: now 1786396120809266 us; error 44 us; skew 500 ppm
I20260810 21:08:40.810859 14968 webserver.cc:460] Webserver started at http://127.15.37.62:42339/ using document root <none> and password file <none>
I20260810 21:08:40.811197 14968 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:40.811254 14968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:40.811451 14968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:40.812767 14968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "c5ea5ec9784c469fad200f3b4edd9d37"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "fea3b7cdb790ee91f17ec8afff21f28a"
server_key_iv: "8539d5f2a6f30f7c0e3cbfcdd2c731b3"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.813176 14968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "c5ea5ec9784c469fad200f3b4edd9d37"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "fea3b7cdb790ee91f17ec8afff21f28a"
server_key_iv: "8539d5f2a6f30f7c0e3cbfcdd2c731b3"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.814630 14968 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:08:40.815543 14997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:40.815753 14968 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:40.815879 14968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "c5ea5ec9784c469fad200f3b4edd9d37"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "fea3b7cdb790ee91f17ec8afff21f28a"
server_key_iv: "8539d5f2a6f30f7c0e3cbfcdd2c731b3"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.815968 14968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:40.841593 14968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:40.841997 14968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:40.842180 14968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:40.846719 14968 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:44955
I20260810 21:08:40.846808 15082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:44955 every 8 connection(s)
I20260810 21:08:40.847208 14968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:40.848371 15083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:40.851323 15083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37: Bootstrap starting.
I20260810 21:08:40.852113 15083 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:40.852521 15083 log.cc:824] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:40.853413 15083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37: No bootstrap required, opened a new log
I20260810 21:08:40.855255 15083 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5ea5ec9784c469fad200f3b4edd9d37" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44955 } }
I20260810 21:08:40.855422 15083 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:40.855446 15083 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ea5ec9784c469fad200f3b4edd9d37, State: Initialized, Role: FOLLOWER
I20260810 21:08:40.855652 15083 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5ea5ec9784c469fad200f3b4edd9d37" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44955 } }
I20260810 21:08:40.855731 15083 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:40.855756 15083 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:40.855808 15083 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:40.856460 15083 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5ea5ec9784c469fad200f3b4edd9d37" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44955 } }
I20260810 21:08:40.856659 15083 leader_election.cc:302] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5ea5ec9784c469fad200f3b4edd9d37; no voters:
I20260810 21:08:40.856937 15083 leader_election.cc:288] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:40.857066 15089 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:40.857143 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 14968
I20260810 21:08:40.857267 15089 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [term 1 LEADER]: Becoming Leader. State: Replica: c5ea5ec9784c469fad200f3b4edd9d37, State: Running, Role: LEADER
I20260810 21:08:40.857282 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:40.857288 15083 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:40.857383 15089 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5ea5ec9784c469fad200f3b4edd9d37" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44955 } }
I20260810 21:08:40.857511 15508 external_mini_cluster.cc:1428] Setting key d4899de79dbac4bbdb54e285d50bd8a0
I20260810 21:08:40.857875 15090 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5ea5ec9784c469fad200f3b4edd9d37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5ea5ec9784c469fad200f3b4edd9d37" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44955 } } }
I20260810 21:08:40.857967 15090 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:40.858255 15091 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5ea5ec9784c469fad200f3b4edd9d37. Latest consensus state: current_term: 1 leader_uuid: "c5ea5ec9784c469fad200f3b4edd9d37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5ea5ec9784c469fad200f3b4edd9d37" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44955 } } }
I20260810 21:08:40.858392 15091 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:40.858659 15102 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:40.859392 15102 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:40.861281 15102 catalog_manager.cc:1347] Generated new cluster ID: 5675df7ff5a4458db23e38990711855e
I20260810 21:08:40.861354 15102 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:08:40.864454 15105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:40.858264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37670 (local address 127.15.37.62:44955)
0810 21:08:40.858821 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:40.858831 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:40.858872 (+ 41us) server_negotiation.cc:407] Connection header received
0810 21:08:40.859027 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:40.859036 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:40.859117 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:40.859277 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:40.859592 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.860849 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.861870 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:40.862357 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:40.862518 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:40.863330 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:40.863335 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:40.863336 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:40.863551 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:40.863639 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:40.863657 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:40.864027 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:40.864070 (+ 43us) server_negotiation.cc:299] Negotiation successful
0810 21:08:40.864176 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":83,"threads_started":1}
I20260810 21:08:40.870208 15102 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:40.870857 15102 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:40.875154 15102 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37: Generated new TSK 0
I20260810 21:08:40.875449 15102 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:40.880048 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.1:0
--local_ip_for_outbound_sockets=127.15.37.1
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44955
--builtin_ntp_servers=127.15.37.20:34523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 21:08:40.982220 15121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:40.982519 15121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:40.982568 15121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:40.983850 15121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:40.983935 15121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:40.983979 15121 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.1
I20260810 21:08:40.985507 15121 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.37.1
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.1
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:40.985803 15121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:40.986152 15121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:40.991776 15131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:40.991776 15132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:40.992177 15135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:40.992623 15121 server_base.cc:1034] running on GCE node
I20260810 21:08:40.992897 15121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:40.993180 15121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:40.994361 15121 hybrid_clock.cc:648] HybridClock initialized: now 1786396120994345 us; error 32 us; skew 500 ppm
I20260810 21:08:40.995936 15121 webserver.cc:460] Webserver started at http://127.15.37.1:43729/ using document root <none> and password file <none>
I20260810 21:08:40.996224 15121 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:40.996302 15121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:40.996515 15121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:40.997788 15121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/data/instance:
uuid: "15bbd20ea1304afa8816a9143e6bf7ff"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "b11f1882f38aee5c387dc2c4cee3264c"
server_key_iv: "a18ef73d310f1038be330813681fb33e"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.998203 15121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance:
uuid: "15bbd20ea1304afa8816a9143e6bf7ff"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "b11f1882f38aee5c387dc2c4cee3264c"
server_key_iv: "a18ef73d310f1038be330813681fb33e"
server_key_version: "encryptionkey@0"
I20260810 21:08:40.999733 15121 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:08:41.000685 15148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:41.000979 15121 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:41.001121 15121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/wal
uuid: "15bbd20ea1304afa8816a9143e6bf7ff"
format_stamp: "Formatted at 2026-08-10 21:08:40 on dist-test-slave-jq4t"
server_key: "b11f1882f38aee5c387dc2c4cee3264c"
server_key_iv: "a18ef73d310f1038be330813681fb33e"
server_key_version: "encryptionkey@0"
I20260810 21:08:41.001231 15121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:41.020012 15121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:41.020429 15121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:41.020627 15121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:41.020852 15121 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:41.021255 15121 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:41.021294 15121 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:41.021319 15121 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:41.021373 15121 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:41.027819 15121 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.1:39505
I20260810 21:08:41.027913 15335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.1:39505 every 8 connection(s)
I20260810 21:08:41.028319 15121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/data/info.pb
I20260810 21:08:41.033948 15105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.029243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.1:33011 (local address 127.15.37.62:44955)
0810 21:08:41.029311 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:41.029313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:41.029566 (+ 253us) server_negotiation.cc:407] Connection header received
0810 21:08:41.030085 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:41.030087 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:41.030100 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:41.030153 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:41.030858 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.031377 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.032416 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.032718 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.032787 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.033689 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:41.033691 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:41.033691 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:41.033696 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:41.033714 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:41.033718 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:41.033769 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:41.033822 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 21:08:41.033880 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 21:08:41.034170 15342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.029226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44955 (local address 127.15.37.1:33011)
0810 21:08:41.029432 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:41.029469 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:41.029995 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:41.030210 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:41.030213 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:41.030222 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:41.030767 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.030771 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.031465 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.031466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.032294 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.032297 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.032808 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.032809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.032941 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.033532 (+ 591us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:08:41.033533 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:41.033572 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:08:41.033595 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:41.033773 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:41.033775 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:41.033777 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 21:08:41.033825 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 21:08:41.033913 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":107,"threads_started":1}
I20260810 21:08:41.034822 15337 heartbeater.cc:347] Connected to a master server at 127.15.37.62:44955
I20260810 21:08:41.034946 15337 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:41.035178 15337 heartbeater.cc:511] Master 127.15.37.62:44955 requested a full tablet report, sending...
I20260810 21:08:41.035773 15021 ts_manager.cc:194] Registered new tserver with Master: 15bbd20ea1304afa8816a9143e6bf7ff (127.15.37.1:39505)
I20260810 21:08:41.036444 15021 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.37.1:33011
I20260810 21:08:41.037734 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 15121
I20260810 21:08:41.037861 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-0/wal/instance
I20260810 21:08:41.038082 15508 external_mini_cluster.cc:1428] Setting key 9b3532a8d9a0c4761257e8eee4c90c66
I20260810 21:08:41.039196 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.2:0
--local_ip_for_outbound_sockets=127.15.37.2
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44955
--builtin_ntp_servers=127.15.37.20:34523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 21:08:41.128798 15343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:41.129025 15343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:41.129060 15343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:41.130304 15343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:41.130354 15343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:41.130383 15343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.2
I20260810 21:08:41.131893 15343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.37.2
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.2
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:41.132203 15343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:41.132613 15343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:41.138085 15355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:41.138092 15353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:41.138206 15343 server_base.cc:1034] running on GCE node
W20260810 21:08:41.138093 15352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:41.138540 15343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:41.138828 15343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:41.140018 15343 hybrid_clock.cc:648] HybridClock initialized: now 1786396121139995 us; error 40 us; skew 500 ppm
I20260810 21:08:41.141646 15343 webserver.cc:460] Webserver started at http://127.15.37.2:33033/ using document root <none> and password file <none>
I20260810 21:08:41.141943 15343 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:41.142022 15343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:41.142192 15343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:41.143452 15343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/data/instance:
uuid: "3047cdae0a674749ada8779b60e210e4"
format_stamp: "Formatted at 2026-08-10 21:08:41 on dist-test-slave-jq4t"
server_key: "f1bfeff343208738172f212ba98c3f92"
server_key_iv: "460baea658c8c3b633870a5dfc6586b2"
server_key_version: "encryptionkey@0"
I20260810 21:08:41.143875 15343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance:
uuid: "3047cdae0a674749ada8779b60e210e4"
format_stamp: "Formatted at 2026-08-10 21:08:41 on dist-test-slave-jq4t"
server_key: "f1bfeff343208738172f212ba98c3f92"
server_key_iv: "460baea658c8c3b633870a5dfc6586b2"
server_key_version: "encryptionkey@0"
I20260810 21:08:41.145542 15343 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260810 21:08:41.146445 15364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:41.146780 15343 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:08:41.146915 15343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/wal
uuid: "3047cdae0a674749ada8779b60e210e4"
format_stamp: "Formatted at 2026-08-10 21:08:41 on dist-test-slave-jq4t"
server_key: "f1bfeff343208738172f212ba98c3f92"
server_key_iv: "460baea658c8c3b633870a5dfc6586b2"
server_key_version: "encryptionkey@0"
I20260810 21:08:41.147109 15343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:41.155582 15343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:41.155961 15343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:41.156126 15343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:41.156376 15343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:41.156834 15343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:41.156898 15343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:41.156937 15343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:41.156985 15343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:41.163514 15343 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.2:37859
I20260810 21:08:41.163565 15547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.2:37859 every 8 connection(s)
I20260810 21:08:41.163959 15343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/data/info.pb
I20260810 21:08:41.165544 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 15343
I20260810 21:08:41.165668 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/wal/instance
I20260810 21:08:41.165881 15508 external_mini_cluster.cc:1428] Setting key db95c5d9690aad123d050b0183a615b8
I20260810 21:08:41.167007 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.37.3:0
--local_ip_for_outbound_sockets=127.15.37.3
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44955
--builtin_ntp_servers=127.15.37.20:34523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 21:08:41.170450 15105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.164890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:58027 (local address 127.15.37.62:44955)
0810 21:08:41.165895 (+ 1005us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:41.165898 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:41.165912 (+ 14us) server_negotiation.cc:407] Connection header received
0810 21:08:41.166137 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:41.166138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:41.166171 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:41.166225 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:41.167149 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.167671 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.168895 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.169112 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.169201 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.170167 (+ 966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:41.170168 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:41.170169 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:41.170174 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:41.170191 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:41.170195 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:41.170247 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:41.170357 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 21:08:41.170385 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":971}
I20260810 21:08:41.170745 15551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.164866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44955 (local address 127.15.37.2:58027)
0810 21:08:41.165155 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:41.165214 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:41.166006 (+ 792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:41.166346 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:41.166350 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:41.166362 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:41.167043 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.167049 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.167788 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.167789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.168797 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.168800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.169216 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.169217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.169370 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.169999 (+ 629us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:08:41.169999 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:41.170041 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:08:41.170071 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:41.170267 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:41.170274 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:41.170277 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:08:41.170350 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 21:08:41.170469 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":127,"threads_started":1}
I20260810 21:08:41.171342 15549 heartbeater.cc:347] Connected to a master server at 127.15.37.62:44955
I20260810 21:08:41.171461 15549 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:41.171684 15549 heartbeater.cc:511] Master 127.15.37.62:44955 requested a full tablet report, sending...
I20260810 21:08:41.172168 15021 ts_manager.cc:194] Registered new tserver with Master: 3047cdae0a674749ada8779b60e210e4 (127.15.37.2:37859)
I20260810 21:08:41.172760 15021 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.37.2:58027
W20260810 21:08:41.257433 15552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:41.257777 15552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:41.257818 15552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:41.259197 15552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:41.259271 15552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:41.259325 15552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.37.3
I20260810 21:08:41.260910 15552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.37.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.37.3
--webserver_port=0
--tserver_master_addrs=127.15.37.62:44955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.37.3
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:41.261245 15552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:41.261619 15552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:41.267217 15560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:41.267215 15559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:41.267211 15562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:41.267474 15552 server_base.cc:1034] running on GCE node
I20260810 21:08:41.267746 15552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:41.268018 15552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:41.269170 15552 hybrid_clock.cc:648] HybridClock initialized: now 1786396121269137 us; error 49 us; skew 500 ppm
I20260810 21:08:41.270660 15552 webserver.cc:460] Webserver started at http://127.15.37.3:37659/ using document root <none> and password file <none>
I20260810 21:08:41.270975 15552 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:41.271026 15552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:41.271222 15552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:41.272396 15552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/data/instance:
uuid: "39c03a4033e945d79c66362e0d579b61"
format_stamp: "Formatted at 2026-08-10 21:08:41 on dist-test-slave-jq4t"
server_key: "49650656351cda055682210bc3019bf3"
server_key_iv: "1e79495266abe111a717c8ffb4dd9104"
server_key_version: "encryptionkey@0"
I20260810 21:08:41.272872 15552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance:
uuid: "39c03a4033e945d79c66362e0d579b61"
format_stamp: "Formatted at 2026-08-10 21:08:41 on dist-test-slave-jq4t"
server_key: "49650656351cda055682210bc3019bf3"
server_key_iv: "1e79495266abe111a717c8ffb4dd9104"
server_key_version: "encryptionkey@0"
I20260810 21:08:41.274389 15552 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:08:41.275239 15569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:41.275436 15552 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:41.275559 15552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/wal
uuid: "39c03a4033e945d79c66362e0d579b61"
format_stamp: "Formatted at 2026-08-10 21:08:41 on dist-test-slave-jq4t"
server_key: "49650656351cda055682210bc3019bf3"
server_key_iv: "1e79495266abe111a717c8ffb4dd9104"
server_key_version: "encryptionkey@0"
I20260810 21:08:41.275643 15552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:41.298710 15552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:41.299124 15552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:41.299304 15552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:41.299582 15552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 21:08:41.299979 15552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 21:08:41.300040 15552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:41.300102 15552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 21:08:41.300150 15552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:41.306569 15552 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.3:39429
I20260810 21:08:41.306672 15743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.3:39429 every 8 connection(s)
I20260810 21:08:41.307039 15552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/data/info.pb
I20260810 21:08:41.313054 15105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.307933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.3:47235 (local address 127.15.37.62:44955)
0810 21:08:41.308014 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:41.308017 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:41.308340 (+ 323us) server_negotiation.cc:407] Connection header received
0810 21:08:41.308924 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:41.308925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:41.308938 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:41.308990 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:41.309693 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.310211 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.311345 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.311530 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.311584 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.312616 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:41.312617 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:41.312617 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:41.312622 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:41.312635 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:41.312639 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:41.312682 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:41.312931 (+ 249us) server_negotiation.cc:299] Negotiation successful
0810 21:08:41.312963 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 21:08:41.313239 15750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.307917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44955 (local address 127.15.37.3:47235)
0810 21:08:41.308159 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:41.308226 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:41.308820 (+ 594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:41.309055 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:41.309059 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:41.309068 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:08:41.309615 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.309620 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.310340 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.310341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.311248 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.311251 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.311615 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.311616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.311739 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.312420 (+ 681us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 21:08:41.312421 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:08:41.312453 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 21:08:41.312523 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:08:41.312773 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:08:41.312781 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:08:41.312784 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 21:08:41.312887 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 21:08:41.312989 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":118,"threads_started":1}
I20260810 21:08:41.313843 15744 heartbeater.cc:347] Connected to a master server at 127.15.37.62:44955
I20260810 21:08:41.313998 15744 heartbeater.cc:464] Registering TS with master...
I20260810 21:08:41.314242 15744 heartbeater.cc:511] Master 127.15.37.62:44955 requested a full tablet report, sending...
I20260810 21:08:41.314695 15021 ts_manager.cc:194] Registered new tserver with Master: 39c03a4033e945d79c66362e0d579b61 (127.15.37.3:39429)
I20260810 21:08:41.314859 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 15552
I20260810 21:08:41.315006 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/wal/instance
I20260810 21:08:41.315172 15021 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.15.37.3:47235
I20260810 21:08:41.315240 15508 external_mini_cluster.cc:1428] Setting key 634f2c7c1f36f02f7ca80b21e92bb1d9
I20260810 21:08:41.316236 15508 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 21:08:41.320616 15105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.317734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37674 (local address 127.15.37.62:44955)
0810 21:08:41.317775 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:41.317777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:41.317912 (+ 135us) server_negotiation.cc:407] Connection header received
0810 21:08:41.317950 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:41.317951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:41.317964 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:41.318005 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:41.318133 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.318601 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.319407 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.319596 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.319649 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.320317 (+ 668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:41.320319 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:41.320319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:41.320323 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:41.320337 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:41.320340 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:41.320383 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:41.320433 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 21:08:41.320463 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 21:08:41.322047 15021 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37674:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 21:08:41.323592 15021 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 21:08:41.330461 15762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.326039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56280 (local address 127.15.37.1:39505)
0810 21:08:41.326273 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:41.326278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:41.326290 (+ 12us) server_negotiation.cc:407] Connection header received
0810 21:08:41.326346 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:41.326348 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:41.326361 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:41.326455 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:41.326639 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.327826 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.329239 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.330009 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.330097 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.330201 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:41.330321 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 21:08:41.330369 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":108,"threads_started":1}
I20260810 21:08:41.330456 15761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.325821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:39505 (local address 127.0.0.1:56280)
0810 21:08:41.325977 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:41.326022 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:41.326114 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:41.326470 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:41.326473 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:41.326476 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:41.326554 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.326556 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.327911 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.327912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.329141 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.329144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.330114 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.330114 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.330204 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.330220 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 21:08:41.330300 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 21:08:41.330369 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":15,"thread_start_us":102,"threads_started":1}
I20260810 21:08:41.330492 15767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.326506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48554 (local address 127.15.37.3:39429)
0810 21:08:41.326713 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:41.326718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:41.326797 (+ 79us) server_negotiation.cc:407] Connection header received
0810 21:08:41.326843 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:41.326845 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:41.326862 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:41.326937 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:41.327145 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.328142 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.329293 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.330014 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.330097 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.330200 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:41.330353 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 21:08:41.330396 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":93,"threads_started":1}
I20260810 21:08:41.330785 15763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.326099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:39429 (local address 127.0.0.1:48554)
0810 21:08:41.326259 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:41.326273 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:41.326329 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:41.327021 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:41.327022 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:41.327025 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:41.327059 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.327061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.328224 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.328225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.329176 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.329179 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.330112 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.330114 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.330204 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.330220 (+ 16us) client_negotiation.cc:769] Sending connection context
0810 21:08:41.330306 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 21:08:41.330717 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":364,"thread_start_us":110,"threads_started":1}
I20260810 21:08:41.331343 15224 tablet_service.cc:1467] Processing CreateTablet for tablet e51c80619aca43eaad92fb503c4fd272 (DEFAULT_TABLE table=test-table [id=6400d6cc027e423d8fc48b9a3dfb3647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:41.331532 15646 tablet_service.cc:1467] Processing CreateTablet for tablet e51c80619aca43eaad92fb503c4fd272 (DEFAULT_TABLE table=test-table [id=6400d6cc027e423d8fc48b9a3dfb3647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:41.331789 15759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.325822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.2:37859 (local address 127.0.0.1:45378)
0810 21:08:41.326211 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:41.326223 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:41.326262 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:41.326705 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:41.326705 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:41.326707 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:41.326754 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.326755 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.327759 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.327760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.329141 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.329144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.331484 (+ 2340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.331485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.331555 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.331560 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 21:08:41.331663 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 21:08:41.331715 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":7,"thread_start_us":89,"threads_started":1}
I20260810 21:08:41.331857 15224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e51c80619aca43eaad92fb503c4fd272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:41.331920 15646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e51c80619aca43eaad92fb503c4fd272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:41.332031 15765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.326292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45378 (local address 127.15.37.2:37859)
0810 21:08:41.326498 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:41.326502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:41.326513 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:08:41.326550 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:41.326552 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:41.326564 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:41.326707 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:41.326842 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.327667 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.330243 (+ 2576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.331375 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.331460 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.331552 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:41.331900 (+ 348us) server_negotiation.cc:299] Negotiation successful
0810 21:08:41.331950 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":94,"threads_started":1}
I20260810 21:08:41.335069 15769 tablet_bootstrap.cc:492] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61: Bootstrap starting.
I20260810 21:08:41.335135 15770 tablet_bootstrap.cc:492] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff: Bootstrap starting.
I20260810 21:08:41.335851 15769 tablet_bootstrap.cc:654] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:41.336030 15770 tablet_bootstrap.cc:654] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:41.335992 15434 tablet_service.cc:1467] Processing CreateTablet for tablet e51c80619aca43eaad92fb503c4fd272 (DEFAULT_TABLE table=test-table [id=6400d6cc027e423d8fc48b9a3dfb3647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 21:08:41.336280 15769 log.cc:824] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:41.336382 15770 log.cc:824] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:41.336431 15434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e51c80619aca43eaad92fb503c4fd272. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:41.337325 15770 tablet_bootstrap.cc:492] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff: No bootstrap required, opened a new log
I20260810 21:08:41.337414 15770 ts_tablet_manager.cc:1397] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 21:08:41.340270 15770 raft_consensus.cc:348] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3047cdae0a674749ada8779b60e210e4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37859 } } peers { permanent_uuid: "15bbd20ea1304afa8816a9143e6bf7ff" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 39505 } } peers { permanent_uuid: "39c03a4033e945d79c66362e0d579b61" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39429 } }
I20260810 21:08:41.340505 15770 raft_consensus.cc:374] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:41.340564 15770 raft_consensus.cc:729] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15bbd20ea1304afa8816a9143e6bf7ff, State: Initialized, Role: FOLLOWER
I20260810 21:08:41.340619 15774 tablet_bootstrap.cc:492] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4: Bootstrap starting.
I20260810 21:08:41.340718 15770 consensus_queue.cc:260] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3047cdae0a674749ada8779b60e210e4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37859 } } peers { permanent_uuid: "15bbd20ea1304afa8816a9143e6bf7ff" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 39505 } } peers { permanent_uuid: "39c03a4033e945d79c66362e0d579b61" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39429 } }
I20260810 21:08:41.341075 15770 ts_tablet_manager.cc:1428] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20260810 21:08:41.341128 15337 heartbeater.cc:503] Master 127.15.37.62:44955 was elected leader, sending a full tablet report...
I20260810 21:08:41.341501 15774 tablet_bootstrap.cc:654] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:41.341871 15774 log.cc:824] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:41.342007 15769 tablet_bootstrap.cc:492] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61: No bootstrap required, opened a new log
I20260810 21:08:41.342110 15769 ts_tablet_manager.cc:1397] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260810 21:08:41.342980 15774 tablet_bootstrap.cc:492] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4: No bootstrap required, opened a new log
I20260810 21:08:41.343075 15774 ts_tablet_manager.cc:1397] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260810 21:08:41.344383 15769 raft_consensus.cc:348] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3047cdae0a674749ada8779b60e210e4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37859 } } peers { permanent_uuid: "15bbd20ea1304afa8816a9143e6bf7ff" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 39505 } } peers { permanent_uuid: "39c03a4033e945d79c66362e0d579b61" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39429 } }
I20260810 21:08:41.344609 15769 raft_consensus.cc:374] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:41.344640 15769 raft_consensus.cc:729] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39c03a4033e945d79c66362e0d579b61, State: Initialized, Role: FOLLOWER
I20260810 21:08:41.344791 15769 consensus_queue.cc:260] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3047cdae0a674749ada8779b60e210e4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37859 } } peers { permanent_uuid: "15bbd20ea1304afa8816a9143e6bf7ff" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 39505 } } peers { permanent_uuid: "39c03a4033e945d79c66362e0d579b61" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39429 } }
I20260810 21:08:41.345103 15769 ts_tablet_manager.cc:1428] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 21:08:41.345173 15744 heartbeater.cc:503] Master 127.15.37.62:44955 was elected leader, sending a full tablet report...
I20260810 21:08:41.345643 15774 raft_consensus.cc:348] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3047cdae0a674749ada8779b60e210e4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37859 } } peers { permanent_uuid: "15bbd20ea1304afa8816a9143e6bf7ff" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 39505 } } peers { permanent_uuid: "39c03a4033e945d79c66362e0d579b61" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39429 } }
I20260810 21:08:41.345809 15774 raft_consensus.cc:374] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:41.345837 15774 raft_consensus.cc:729] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3047cdae0a674749ada8779b60e210e4, State: Initialized, Role: FOLLOWER
I20260810 21:08:41.345968 15774 consensus_queue.cc:260] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3047cdae0a674749ada8779b60e210e4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37859 } } peers { permanent_uuid: "15bbd20ea1304afa8816a9143e6bf7ff" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 39505 } } peers { permanent_uuid: "39c03a4033e945d79c66362e0d579b61" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39429 } }
I20260810 21:08:41.346275 15774 ts_tablet_manager.cc:1428] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 21:08:41.346313 15549 heartbeater.cc:503] Master 127.15.37.62:44955 was elected leader, sending a full tablet report...
I20260810 21:08:41.390810 15786 raft_consensus.cc:482] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 21:08:41.390987 15786 raft_consensus.cc:504] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3047cdae0a674749ada8779b60e210e4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37859 } } peers { permanent_uuid: "15bbd20ea1304afa8816a9143e6bf7ff" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 39505 } } peers { permanent_uuid: "39c03a4033e945d79c66362e0d579b61" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39429 } }
I20260810 21:08:41.391382 15786 leader_election.cc:288] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15bbd20ea1304afa8816a9143e6bf7ff (127.15.37.1:39505), 39c03a4033e945d79c66362e0d579b61 (127.15.37.3:39429)
I20260810 21:08:41.394408 15762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.391702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:60513 (local address 127.15.37.1:39505)
0810 21:08:41.391759 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:41.391762 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:41.391772 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:08:41.391813 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:41.391814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:41.391824 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:41.391898 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:41.392089 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.392643 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.393639 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.394010 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.394111 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.394123 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:41.394274 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 21:08:41.394318 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 21:08:41.394434 15767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.391681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.15.37.2:39013 (local address 127.15.37.3:39429)
0810 21:08:41.391734 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:41.391736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:41.391873 (+ 137us) server_negotiation.cc:407] Connection header received
0810 21:08:41.391950 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:41.391951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:41.391959 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:41.392028 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 21:08:41.392191 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.392728 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.393673 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.394043 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.394130 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.394141 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:41.394316 (+ 175us) server_negotiation.cc:299] Negotiation successful
0810 21:08:41.394360 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 21:08:41.394466 15551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.391572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:39505 (local address 127.15.37.2:60513)
0810 21:08:41.391637 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:41.391650 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:41.391698 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:41.391921 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:41.391923 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:41.391924 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:41.392006 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.392008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.392730 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.392731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.393529 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.393531 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.394114 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.394115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.394197 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.394201 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 21:08:41.394268 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 21:08:41.394318 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 21:08:41.394490 15789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.391607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.3:39429 (local address 127.15.37.2:39013)
0810 21:08:41.391793 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:41.391802 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:08:41.391874 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:08:41.392032 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:08:41.392033 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:08:41.392034 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 21:08:41.392113 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.392114 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.392814 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.392815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.393573 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:08:41.393575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.394135 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.394137 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:08:41.394222 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.394231 (+ 9us) client_negotiation.cc:769] Sending connection context
0810 21:08:41.394296 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 21:08:41.394341 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":114,"threads_started":1}
I20260810 21:08:41.394863 15253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e51c80619aca43eaad92fb503c4fd272" candidate_uuid: "3047cdae0a674749ada8779b60e210e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15bbd20ea1304afa8816a9143e6bf7ff" is_pre_election: true
I20260810 21:08:41.394866 15674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e51c80619aca43eaad92fb503c4fd272" candidate_uuid: "3047cdae0a674749ada8779b60e210e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39c03a4033e945d79c66362e0d579b61" is_pre_election: true
I20260810 21:08:41.395061 15253 raft_consensus.cc:2454] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3047cdae0a674749ada8779b60e210e4 in term 0.
I20260810 21:08:41.395068 15674 raft_consensus.cc:2454] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3047cdae0a674749ada8779b60e210e4 in term 0.
I20260810 21:08:41.395372 15369 leader_election.cc:302] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3047cdae0a674749ada8779b60e210e4, 39c03a4033e945d79c66362e0d579b61; no voters:
I20260810 21:08:41.395597 15786 raft_consensus.cc:2781] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 21:08:41.395644 15786 raft_consensus.cc:482] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 21:08:41.395661 15786 raft_consensus.cc:3037] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:41.396417 15786 raft_consensus.cc:504] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3047cdae0a674749ada8779b60e210e4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37859 } } peers { permanent_uuid: "15bbd20ea1304afa8816a9143e6bf7ff" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 39505 } } peers { permanent_uuid: "39c03a4033e945d79c66362e0d579b61" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39429 } }
I20260810 21:08:41.396624 15786 leader_election.cc:288] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [CANDIDATE]: Term 1 election: Requested vote from peers 15bbd20ea1304afa8816a9143e6bf7ff (127.15.37.1:39505), 39c03a4033e945d79c66362e0d579b61 (127.15.37.3:39429)
I20260810 21:08:41.396814 15253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e51c80619aca43eaad92fb503c4fd272" candidate_uuid: "3047cdae0a674749ada8779b60e210e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15bbd20ea1304afa8816a9143e6bf7ff"
I20260810 21:08:41.396833 15674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e51c80619aca43eaad92fb503c4fd272" candidate_uuid: "3047cdae0a674749ada8779b60e210e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39c03a4033e945d79c66362e0d579b61"
I20260810 21:08:41.396907 15253 raft_consensus.cc:3037] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:41.396926 15674 raft_consensus.cc:3037] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:41.397717 15253 raft_consensus.cc:2454] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3047cdae0a674749ada8779b60e210e4 in term 1.
I20260810 21:08:41.397737 15674 raft_consensus.cc:2454] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3047cdae0a674749ada8779b60e210e4 in term 1.
I20260810 21:08:41.397931 15368 leader_election.cc:302] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15bbd20ea1304afa8816a9143e6bf7ff, 3047cdae0a674749ada8779b60e210e4; no voters:
I20260810 21:08:41.398033 15786 raft_consensus.cc:2781] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:41.398190 15786 raft_consensus.cc:686] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [term 1 LEADER]: Becoming Leader. State: Replica: 3047cdae0a674749ada8779b60e210e4, State: Running, Role: LEADER
I20260810 21:08:41.398412 15786 consensus_queue.cc:237] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3047cdae0a674749ada8779b60e210e4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37859 } } peers { permanent_uuid: "15bbd20ea1304afa8816a9143e6bf7ff" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 39505 } } peers { permanent_uuid: "39c03a4033e945d79c66362e0d579b61" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39429 } }
I20260810 21:08:41.399435 15020 catalog_manager.cc:5495] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3047cdae0a674749ada8779b60e210e4 (127.15.37.2). New cstate: current_term: 1 leader_uuid: "3047cdae0a674749ada8779b60e210e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3047cdae0a674749ada8779b60e210e4" member_type: VOTER last_known_addr { host: "127.15.37.2" port: 37859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "15bbd20ea1304afa8816a9143e6bf7ff" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 39505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39c03a4033e945d79c66362e0d579b61" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39429 } health_report { overall_health: UNKNOWN } } }
W20260810 21:08:41.414637 15550 tablet.cc:2369] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 21:08:41.424037 15765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.421304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45388 (local address 127.15.37.2:37859)
0810 21:08:41.421369 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:41.421371 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:41.421381 (+ 10us) server_negotiation.cc:407] Connection header received
0810 21:08:41.421439 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:41.421440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:41.421459 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:41.421531 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:08:41.421884 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.422407 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.423263 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:41.423477 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:41.423542 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:41.423693 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:08:41.423819 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:08:41.423901 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:41.423916 (+ 15us) server_negotiation.cc:299] Negotiation successful
0810 21:08:41.423933 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 21:08:41.426234 15253 raft_consensus.cc:1261] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff [term 1 FOLLOWER]: Refusing update from remote peer 3047cdae0a674749ada8779b60e210e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:08:41.426247 15674 raft_consensus.cc:1261] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61 [term 1 FOLLOWER]: Refusing update from remote peer 3047cdae0a674749ada8779b60e210e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:08:41.426710 15786 consensus_queue.cc:1035] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39c03a4033e945d79c66362e0d579b61" member_type: VOTER last_known_addr { host: "127.15.37.3" port: 39429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:08:41.426895 15792 consensus_queue.cc:1035] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15bbd20ea1304afa8816a9143e6bf7ff" member_type: VOTER last_known_addr { host: "127.15.37.1" port: 39505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:08:41.430153 15802 mvcc.cc:205] Tried to move back new op lower bound from 7317078513358422016 to 7317078513248825344. Current Snapshot: MvccSnapshot[applied={T|T < 7317078513358422016 or (T in {7317078513358422016})}]
I20260810 21:08:41.430963 15804 mvcc.cc:205] Tried to move back new op lower bound from 7317078513358422016 to 7317078513248825344. Current Snapshot: MvccSnapshot[applied={T|T < 7317078513358422016}]
I20260810 21:08:41.432092 15020 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:08:41.432186 15020 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 21:08:41.433063 15020 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c5ea5ec9784c469fad200f3b4edd9d37: Sending DeleteTablet for 3 replicas of tablet e51c80619aca43eaad92fb503c4fd272
I20260810 21:08:41.433409 15434 tablet_service.cc:1514] Processing DeleteTablet for tablet e51c80619aca43eaad92fb503c4fd272 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:41 UTC) from {username='slave'} at 127.0.0.1:45378
I20260810 21:08:41.433440 15646 tablet_service.cc:1514] Processing DeleteTablet for tablet e51c80619aca43eaad92fb503c4fd272 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:41 UTC) from {username='slave'} at 127.0.0.1:48554
I20260810 21:08:41.433697 15817 tablet_replica.cc:330] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61: stopping tablet replica
I20260810 21:08:41.433820 15817 raft_consensus.cc:2229] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:08:41.433804 15224 tablet_service.cc:1514] Processing DeleteTablet for tablet e51c80619aca43eaad92fb503c4fd272 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 21:08:41 UTC) from {username='slave'} at 127.0.0.1:56280
I20260810 21:08:41.433948 15817 raft_consensus.cc:2258] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:08:41.434085 15820 tablet_replica.cc:330] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff: stopping tablet replica
I20260810 21:08:41.434249 15820 raft_consensus.cc:2229] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 21:08:41.434330 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 15121
I20260810 21:08:41.434469 15817 ts_tablet_manager.cc:1905] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:08:41.434477 15820 raft_consensus.cc:2258] T e51c80619aca43eaad92fb503c4fd272 P 15bbd20ea1304afa8816a9143e6bf7ff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:08:41.436899 15817 ts_tablet_manager.cc:1918] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:08:41.437031 15817 log.cc:1196] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-2/wal/wals/e51c80619aca43eaad92fb503c4fd272
I20260810 21:08:41.437357 15817 ts_tablet_manager.cc:1939] T e51c80619aca43eaad92fb503c4fd272 P 39c03a4033e945d79c66362e0d579b61: Deleting consensus metadata
I20260810 21:08:41.445449 15816 tablet_replica.cc:330] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4: stopping tablet replica
I20260810 21:08:41.445549 15001 catalog_manager.cc:4841] TS 39c03a4033e945d79c66362e0d579b61 (127.15.37.3:39429): tablet e51c80619aca43eaad92fb503c4fd272 (table test-table [id=6400d6cc027e423d8fc48b9a3dfb3647]) successfully deleted
I20260810 21:08:41.445786 15816 raft_consensus.cc:2229] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [term 1 LEADER]: Raft consensus shutting down.
I20260810 21:08:41.445969 15816 raft_consensus.cc:2258] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 21:08:41.450093 15816 ts_tablet_manager.cc:1905] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 21:08:41.452205 15816 ts_tablet_manager.cc:1918] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 21:08:41.452376 15816 log.cc:1196] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4: Deleting WAL directory at /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786395855004795-15508-0/minicluster-data/ts-1/wal/wals/e51c80619aca43eaad92fb503c4fd272
I20260810 21:08:41.452734 15816 ts_tablet_manager.cc:1939] T e51c80619aca43eaad92fb503c4fd272 P 3047cdae0a674749ada8779b60e210e4: Deleting consensus metadata
I20260810 21:08:41.453311 14999 catalog_manager.cc:4841] TS 3047cdae0a674749ada8779b60e210e4 (127.15.37.2:37859): tablet e51c80619aca43eaad92fb503c4fd272 (table test-table [id=6400d6cc027e423d8fc48b9a3dfb3647]) successfully deleted
W20260810 21:08:41.454705 15000 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.15.37.1:39505 (error 108)
I20260810 21:08:41.455302 15763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:41.455137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.1:39505 (local address 127.0.0.1:56290)
0810 21:08:41.455209 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 21:08:41.455262 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.1:39505: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260810 21:08:41.455412 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 15343
W20260810 21:08:41.459340 15000 catalog_manager.cc:4584] TS 15bbd20ea1304afa8816a9143e6bf7ff (127.15.37.1:39505): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e51c80619aca43eaad92fb503c4fd272: Network error: Client connection negotiation failed: client connection to 127.15.37.1:39505: connect: Connection refused (error 111)
I20260810 21:08:41.467178 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 15552
I20260810 21:08:41.480062 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 14968
2026-08-10T21:08:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (806 ms)
[----------] 6 tests from EncryptionPolicyTest (9964 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:41 dist-test-slave-jq4t krb5kdc[15825](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:41 dist-test-slave-jq4t krb5kdc[15825](info): set up 2 sockets
Aug 10 21:08:41 dist-test-slave-jq4t krb5kdc[15825](info): commencing operation
krb5kdc: starting...
W20260810 21:08:42.769295 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.261s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:42 dist-test-slave-jq4t krb5kdc[15825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 21:08:42.915859 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41529
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41529
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:43.002853 15850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:43.003149 15850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:43.003192 15850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:43.004400 15850 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:43.004511 15850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:43.004554 15850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:43.004586 15850 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:43.004611 15850 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:43.006211 15850 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41529
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41529
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:43.006522 15850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:43.006788 15850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:43.012142 15858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:43.012136 15860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:43.012156 15857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:43.012431 15850 server_base.cc:1034] running on GCE node
I20260810 21:08:43.012727 15850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:43.013087 15850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:43.014285 15850 hybrid_clock.cc:648] HybridClock initialized: now 1786396123014262 us; error 42 us; skew 500 ppm
Aug 10 21:08:43 dist-test-slave-jq4t krb5kdc[15825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396123, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:43.021133 15850 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 21:08:43.021833 15850 webserver.cc:460] Webserver started at http://127.0.0.1:38765/ using document root <none> and password file <none>
I20260810 21:08:43.022179 15850 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:43.022231 15850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:43.022333 15850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:43.023473 15850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "1e6bb5e91a7740959fedc28a5e04ad2a"
format_stamp: "Formatted at 2026-08-10 21:08:43 on dist-test-slave-jq4t"
server_key: "faf85e5bdbc304eddfa7cd3a6a7d3b69"
server_key_iv: "f962722b4d1dfe0db4d9f5eeb845a255"
server_key_version: "encryptionkey@0"
I20260810 21:08:43.023804 15850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "1e6bb5e91a7740959fedc28a5e04ad2a"
format_stamp: "Formatted at 2026-08-10 21:08:43 on dist-test-slave-jq4t"
server_key: "faf85e5bdbc304eddfa7cd3a6a7d3b69"
server_key_iv: "f962722b4d1dfe0db4d9f5eeb845a255"
server_key_version: "encryptionkey@0"
I20260810 21:08:43.025326 15850 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:08:43.026130 15868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:43.026335 15850 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:43.026417 15850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "1e6bb5e91a7740959fedc28a5e04ad2a"
format_stamp: "Formatted at 2026-08-10 21:08:43 on dist-test-slave-jq4t"
server_key: "faf85e5bdbc304eddfa7cd3a6a7d3b69"
server_key_iv: "f962722b4d1dfe0db4d9f5eeb845a255"
server_key_version: "encryptionkey@0"
I20260810 21:08:43.026477 15850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:43.058410 15850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:43.061170 15850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:43.061301 15850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:43.066077 15850 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41529
I20260810 21:08:43.066115 15954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41529 every 8 connection(s)
I20260810 21:08:43.066540 15850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:43.067512 15958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:43.070098 15958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a: Bootstrap starting.
I20260810 21:08:43.070761 15958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:43.071128 15958 log.cc:824] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:43.071951 15958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a: No bootstrap required, opened a new log
I20260810 21:08:43.072849 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 15850
I20260810 21:08:43.072978 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:43.073189 15508 external_mini_cluster.cc:1428] Setting key d0d27471f1e92ec7f58de71040571143
I20260810 21:08:43.074084 15958 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6bb5e91a7740959fedc28a5e04ad2a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41529 } }
I20260810 21:08:43.074292 15958 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:43.074330 15958 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e6bb5e91a7740959fedc28a5e04ad2a, State: Initialized, Role: FOLLOWER
I20260810 21:08:43.074465 15958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6bb5e91a7740959fedc28a5e04ad2a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41529 } }
I20260810 21:08:43.074555 15958 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:43.074591 15958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:43.074645 15958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:43.075424 15958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6bb5e91a7740959fedc28a5e04ad2a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41529 } }
I20260810 21:08:43.075547 15958 leader_election.cc:302] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e6bb5e91a7740959fedc28a5e04ad2a; no voters:
I20260810 21:08:43.075722 15958 leader_election.cc:288] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:43.075819 15970 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:43.075989 15970 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [term 1 LEADER]: Becoming Leader. State: Replica: 1e6bb5e91a7740959fedc28a5e04ad2a, State: Running, Role: LEADER
I20260810 21:08:43.075996 15958 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:43.076122 15970 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6bb5e91a7740959fedc28a5e04ad2a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41529 } }
I20260810 21:08:43.076520 15970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e6bb5e91a7740959fedc28a5e04ad2a. Latest consensus state: current_term: 1 leader_uuid: "1e6bb5e91a7740959fedc28a5e04ad2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6bb5e91a7740959fedc28a5e04ad2a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41529 } } }
I20260810 21:08:43.076623 15970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:43.076529 15972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e6bb5e91a7740959fedc28a5e04ad2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e6bb5e91a7740959fedc28a5e04ad2a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41529 } } }
I20260810 21:08:43.076768 15972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:43.076844 15981 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:43.077375 15981 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:43.079255 15981 catalog_manager.cc:1347] Generated new cluster ID: 7c392887b8e1403f864861ad02be7f9b
I20260810 21:08:43.079314 15981 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:08:43 dist-test-slave-jq4t krb5kdc[15825](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 21:08:43.085851 15964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:43.073849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43173 (local address 127.0.0.1:41529)
0810 21:08:43.074103 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:43.074114 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:43.074164 (+ 50us) server_negotiation.cc:407] Connection header received
0810 21:08:43.074286 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:43.074294 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:43.074355 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:43.074551 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:43.075352 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:43.076859 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:43.077941 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:43.078429 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:43.078562 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:43.081767 (+ 3205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:43.081771 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:43.081772 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:43.081785 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:43.083902 (+ 2117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:43.084436 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:43.084440 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:43.084440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:43.084587 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:43.084870 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:43.084870 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:43.084871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:43.085196 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:43.085371 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:43.085500 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 21:08:43.085608 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":137,"threads_started":1}
I20260810 21:08:43.086900 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:08:43.099956 15981 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:43.100800 15981 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:43.105760 15964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:43.088551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60381 (local address 127.0.0.1:41529)
0810 21:08:43.088594 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:43.088596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:43.096759 (+ 8163us) server_negotiation.cc:407] Connection header received
0810 21:08:43.096814 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:43.096815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:43.096832 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:43.096916 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:43.097651 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:43.098937 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:43.099903 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:43.100264 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:43.100342 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:43.102030 (+ 1688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:43.102032 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:43.102032 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:43.102041 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:43.104135 (+ 2094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:43.104703 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:43.104704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:43.104705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:43.104782 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:43.105040 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:43.105041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:43.105041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:43.105199 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:43.105311 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:43.105468 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 21:08:43.105651 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":427,"server-negotiator.queue_time_us":19}
I20260810 21:08:43.122334 15981 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e6bb5e91a7740959fedc28a5e04ad2a: Generated new TSK 0
I20260810 21:08:43.122646 15981 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:43.127689 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 15850
W20260810 21:08:43.148926 15823 connection.cc:535] client connection to 127.0.0.1:41529 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41529): Connection reset by peer (error 104)
2026-08-10T21:08:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1654 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:43 dist-test-slave-jq4t krb5kdc[16011](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:43 dist-test-slave-jq4t krb5kdc[16011](info): set up 2 sockets
Aug 10 21:08:43 dist-test-slave-jq4t krb5kdc[16011](info): commencing operation
krb5kdc: starting...
W20260810 21:08:44.417192 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.254s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:44 dist-test-slave-jq4t krb5kdc[16011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 21:08:44.552273 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33273
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33273
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:44.639662 16026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:44.639896 16026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:44.639921 16026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:44.641094 16026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:44.641141 16026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:44.641156 16026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:44.641168 16026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:44.641181 16026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:44.642714 16026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33273
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:44.642944 16026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:44.643141 16026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:44.648524 16037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:44.648483 16044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:44.648548 16038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:44.648941 16026 server_base.cc:1034] running on GCE node
I20260810 21:08:44.649333 16026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:44.649675 16026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:44.650851 16026 hybrid_clock.cc:648] HybridClock initialized: now 1786396124650823 us; error 72 us; skew 500 ppm
Aug 10 21:08:44 dist-test-slave-jq4t krb5kdc[16011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396124, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:44.653659 16026 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 21:08:44.654199 16026 webserver.cc:460] Webserver started at http://127.0.0.1:46501/ using document root <none> and password file <none>
I20260810 21:08:44.654475 16026 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:44.654556 16026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:44.654712 16026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:44.655856 16026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "af3a78a6cc124ca1807ebfde7c95fef3"
format_stamp: "Formatted at 2026-08-10 21:08:44 on dist-test-slave-jq4t"
server_key: "e76605ef5855bab2e56122e0412f7f3f"
server_key_iv: "784836068ca26c314a0528069c33879b"
server_key_version: "encryptionkey@0"
I20260810 21:08:44.656242 16026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "af3a78a6cc124ca1807ebfde7c95fef3"
format_stamp: "Formatted at 2026-08-10 21:08:44 on dist-test-slave-jq4t"
server_key: "e76605ef5855bab2e56122e0412f7f3f"
server_key_iv: "784836068ca26c314a0528069c33879b"
server_key_version: "encryptionkey@0"
I20260810 21:08:44.657805 16026 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:08:44.658761 16054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:44.659040 16026 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:44.659157 16026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "af3a78a6cc124ca1807ebfde7c95fef3"
format_stamp: "Formatted at 2026-08-10 21:08:44 on dist-test-slave-jq4t"
server_key: "e76605ef5855bab2e56122e0412f7f3f"
server_key_iv: "784836068ca26c314a0528069c33879b"
server_key_version: "encryptionkey@0"
I20260810 21:08:44.659246 16026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:44.675993 16026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:44.678304 16026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:44.678496 16026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:44.683030 16026 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33273
I20260810 21:08:44.683075 16138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33273 every 8 connection(s)
I20260810 21:08:44.683485 16026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:44.684443 16139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:44.686851 16139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3: Bootstrap starting.
I20260810 21:08:44.687463 16139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:44.687717 16139 log.cc:824] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:44.688584 16139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3: No bootstrap required, opened a new log
I20260810 21:08:44.688800 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 16026
I20260810 21:08:44.688953 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:44.689146 15508 external_mini_cluster.cc:1428] Setting key cd4c2fc5727f9098cf4b08ca6b055515
I20260810 21:08:44.690845 16139 raft_consensus.cc:348] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af3a78a6cc124ca1807ebfde7c95fef3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33273 } }
I20260810 21:08:44.691053 16139 raft_consensus.cc:374] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:44.691098 16139 raft_consensus.cc:729] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af3a78a6cc124ca1807ebfde7c95fef3, State: Initialized, Role: FOLLOWER
I20260810 21:08:44.691252 16139 consensus_queue.cc:260] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af3a78a6cc124ca1807ebfde7c95fef3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33273 } }
I20260810 21:08:44.691350 16139 raft_consensus.cc:388] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:44.691406 16139 raft_consensus.cc:482] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:44.691460 16139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:44.692098 16139 raft_consensus.cc:504] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af3a78a6cc124ca1807ebfde7c95fef3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33273 } }
I20260810 21:08:44.692193 16139 leader_election.cc:302] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af3a78a6cc124ca1807ebfde7c95fef3; no voters:
I20260810 21:08:44.692408 16139 leader_election.cc:288] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:44.692431 16146 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:44.692569 16146 raft_consensus.cc:686] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [term 1 LEADER]: Becoming Leader. State: Replica: af3a78a6cc124ca1807ebfde7c95fef3, State: Running, Role: LEADER
I20260810 21:08:44.692730 16139 sys_catalog.cc:564] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:44.692729 16146 consensus_queue.cc:237] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af3a78a6cc124ca1807ebfde7c95fef3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33273 } }
I20260810 21:08:44.693369 16149 sys_catalog.cc:455] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af3a78a6cc124ca1807ebfde7c95fef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af3a78a6cc124ca1807ebfde7c95fef3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33273 } } }
I20260810 21:08:44.693490 16149 sys_catalog.cc:458] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:44.693704 16148 sys_catalog.cc:455] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af3a78a6cc124ca1807ebfde7c95fef3. Latest consensus state: current_term: 1 leader_uuid: "af3a78a6cc124ca1807ebfde7c95fef3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af3a78a6cc124ca1807ebfde7c95fef3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33273 } } }
I20260810 21:08:44.693789 16148 sys_catalog.cc:458] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:44.693861 16159 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:44.694471 16159 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:44.696189 16159 catalog_manager.cc:1347] Generated new cluster ID: a86bdae0edbe402e86370afcfa51d362
I20260810 21:08:44.696249 16159 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:08:44.696811 16145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:44.689725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35993 (local address 127.0.0.1:33273)
0810 21:08:44.689931 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:44.689939 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:44.689966 (+ 27us) server_negotiation.cc:407] Connection header received
0810 21:08:44.690803 (+ 837us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:44.690810 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:44.690871 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:44.690994 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:44.691294 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:44.692856 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:44.694067 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:44.694777 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:44.694908 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:44.695973 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:44.695977 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:44.695978 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:44.696195 (+ 217us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:44.696242 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:44.696260 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:44.696354 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:44.696555 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 21:08:44.696589 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":104,"threads_started":1}
I20260810 21:08:44.697824 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:08:44.704409 16145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:44.699423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58007 (local address 127.0.0.1:33273)
0810 21:08:44.699461 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:44.699463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:44.700759 (+ 1296us) server_negotiation.cc:407] Connection header received
0810 21:08:44.700807 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:44.700808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:44.700832 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:44.700906 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:44.701042 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:44.701785 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:44.702806 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:44.703144 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:44.703225 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:44.704002 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:44.704004 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:44.704004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:44.704010 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:44.704028 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:44.704033 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:44.704101 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:44.704193 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 21:08:44.704208 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 21:08:44.710291 16159 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:44.710902 16159 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:44.716678 16159 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af3a78a6cc124ca1807ebfde7c95fef3: Generated new TSK 0
I20260810 21:08:44.716936 16159 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:44.719789 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 16026
W20260810 21:08:44.739639 16009 connection.cc:535] client connection to 127.0.0.1:33273 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33273): Connection reset by peer (error 104)
2026-08-10T21:08:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1590 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:44 dist-test-slave-jq4t krb5kdc[16185](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:44 dist-test-slave-jq4t krb5kdc[16185](info): set up 2 sockets
Aug 10 21:08:44 dist-test-slave-jq4t krb5kdc[16185](info): commencing operation
krb5kdc: starting...
W20260810 21:08:46.008540 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.255s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:46 dist-test-slave-jq4t krb5kdc[16185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396126, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 21:08:46.147531 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45373
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:46.237576 16202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:46.237825 16202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:46.237851 16202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:46.239050 16202 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:46.239099 16202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:46.239122 16202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:46.239135 16202 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:46.239147 16202 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:46.240911 16202 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45373
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:46.241173 16202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:46.241384 16202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:46.246850 16207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:46.246938 16202 server_base.cc:1034] running on GCE node
W20260810 21:08:46.246835 16213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:46.246835 16211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:46.247413 16202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:46.247772 16202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:46.248961 16202 hybrid_clock.cc:648] HybridClock initialized: now 1786396126248938 us; error 48 us; skew 500 ppm
Aug 10 21:08:46 dist-test-slave-jq4t krb5kdc[16185](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396126, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:46.251710 16202 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 21:08:46.252233 16202 webserver.cc:460] Webserver started at http://127.0.0.1:45347/ using document root <none> and password file <none>
I20260810 21:08:46.252568 16202 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:46.252643 16202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:46.252811 16202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:46.253943 16202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "abfe7cfa6627495eb92df78f479b0f5c"
format_stamp: "Formatted at 2026-08-10 21:08:46 on dist-test-slave-jq4t"
server_key: "72412364d3c66e76d1f274ebaa8cd231"
server_key_iv: "35746829d01574199d8bf3f0e4c1a6a7"
server_key_version: "encryptionkey@0"
I20260810 21:08:46.254343 16202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "abfe7cfa6627495eb92df78f479b0f5c"
format_stamp: "Formatted at 2026-08-10 21:08:46 on dist-test-slave-jq4t"
server_key: "72412364d3c66e76d1f274ebaa8cd231"
server_key_iv: "35746829d01574199d8bf3f0e4c1a6a7"
server_key_version: "encryptionkey@0"
I20260810 21:08:46.255868 16202 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:08:46.256824 16227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:46.257102 16202 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:46.257231 16202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "abfe7cfa6627495eb92df78f479b0f5c"
format_stamp: "Formatted at 2026-08-10 21:08:46 on dist-test-slave-jq4t"
server_key: "72412364d3c66e76d1f274ebaa8cd231"
server_key_iv: "35746829d01574199d8bf3f0e4c1a6a7"
server_key_version: "encryptionkey@0"
I20260810 21:08:46.257318 16202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:46.261070 16202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:46.263331 16202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:46.263507 16202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:46.268046 16202 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45373
I20260810 21:08:46.268082 16313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45373 every 8 connection(s)
I20260810 21:08:46.268533 16202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:46.269752 16314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:46.272228 16314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c: Bootstrap starting.
I20260810 21:08:46.272934 16314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:46.273205 16314 log.cc:824] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:46.273980 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 16202
I20260810 21:08:46.274073 16314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c: No bootstrap required, opened a new log
I20260810 21:08:46.274120 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:46.274348 15508 external_mini_cluster.cc:1428] Setting key 586b094ef9ec445cfbd85ec180a6f81b
I20260810 21:08:46.276176 16314 raft_consensus.cc:348] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfe7cfa6627495eb92df78f479b0f5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45373 } }
I20260810 21:08:46.276360 16314 raft_consensus.cc:374] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:46.276399 16314 raft_consensus.cc:729] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abfe7cfa6627495eb92df78f479b0f5c, State: Initialized, Role: FOLLOWER
I20260810 21:08:46.276571 16314 consensus_queue.cc:260] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfe7cfa6627495eb92df78f479b0f5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45373 } }
I20260810 21:08:46.276714 16314 raft_consensus.cc:388] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:46.276769 16314 raft_consensus.cc:482] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:46.276825 16314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:46.277745 16323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:46.274958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45549 (local address 127.0.0.1:45373)
0810 21:08:46.275153 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:46.275161 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:46.275188 (+ 27us) server_negotiation.cc:407] Connection header received
0810 21:08:46.276166 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:46.276176 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:46.276211 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:46.276389 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:46.277187 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:46.277193 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:46.277194 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:46.277200 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:46.277258 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:46.277273 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:46.277361 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:46.277443 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 21:08:46.277499 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":96,"threads_started":1}
I20260810 21:08:46.278316 16314 raft_consensus.cc:504] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfe7cfa6627495eb92df78f479b0f5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45373 } }
I20260810 21:08:46.278468 16314 leader_election.cc:302] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abfe7cfa6627495eb92df78f479b0f5c; no voters:
I20260810 21:08:46.278666 16314 leader_election.cc:288] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:46.278865 16325 raft_consensus.cc:2781] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:46.278857 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:08:46.278983 16314 sys_catalog.cc:564] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:46.279060 16325 raft_consensus.cc:686] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [term 1 LEADER]: Becoming Leader. State: Replica: abfe7cfa6627495eb92df78f479b0f5c, State: Running, Role: LEADER
I20260810 21:08:46.279186 16325 consensus_queue.cc:237] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfe7cfa6627495eb92df78f479b0f5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45373 } }
I20260810 21:08:46.279584 16325 sys_catalog.cc:455] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader abfe7cfa6627495eb92df78f479b0f5c. Latest consensus state: current_term: 1 leader_uuid: "abfe7cfa6627495eb92df78f479b0f5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfe7cfa6627495eb92df78f479b0f5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45373 } } }
I20260810 21:08:46.279599 16326 sys_catalog.cc:455] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abfe7cfa6627495eb92df78f479b0f5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abfe7cfa6627495eb92df78f479b0f5c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45373 } } }
I20260810 21:08:46.279770 16325 sys_catalog.cc:458] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:46.279783 16326 sys_catalog.cc:458] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c [sys.catalog]: This master's current role is: LEADER
W20260810 21:08:46.281260 16354 catalog_manager.cc:1558] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:08:46.281368 16354 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:08:46.281461 16335 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:46.281688 16335 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:46.282047 16323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:46.280686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37795 (local address 127.0.0.1:45373)
0810 21:08:46.280729 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:46.280732 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:46.280865 (+ 133us) server_negotiation.cc:407] Connection header received
0810 21:08:46.280991 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:46.280992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:46.280997 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:46.281057 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:46.281782 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:46.281783 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:46.281784 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:46.281790 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:46.281808 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:46.281813 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:46.281881 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:46.281968 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 21:08:46.281983 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 21:08:46.283521 16335 catalog_manager.cc:1347] Generated new cluster ID: 23e5722799864ddbb68e5a538d7ab1d1
I20260810 21:08:46.283581 16335 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:08:46.294621 16335 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:46.294832 16335 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:46.298736 16335 catalog_manager.cc:5868] T 00000000000000000000000000000000 P abfe7cfa6627495eb92df78f479b0f5c: Generated new TSK 0
I20260810 21:08:46.298936 16335 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:46.306535 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 16202
2026-08-10T21:08:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1601 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:46 dist-test-slave-jq4t krb5kdc[16363](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:46 dist-test-slave-jq4t krb5kdc[16363](info): set up 2 sockets
Aug 10 21:08:46 dist-test-slave-jq4t krb5kdc[16363](info): commencing operation
krb5kdc: starting...
W20260810 21:08:47.614552 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.259s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:47 dist-test-slave-jq4t krb5kdc[16363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396127, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 21:08:47.752759 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45129
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41531
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:47.841666 16389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:47.841912 16389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:47.841938 16389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:47.843230 16389 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:47.843290 16389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:47.843305 16389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:47.843319 16389 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:47.843331 16389 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:47.845088 16389 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41531
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:47.845400 16389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:47.845675 16389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:47.851046 16402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:47.851068 16398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:47.851063 16399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:47.851274 16389 server_base.cc:1034] running on GCE node
I20260810 21:08:47.851711 16389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:47.852056 16389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:47.853232 16389 hybrid_clock.cc:648] HybridClock initialized: now 1786396127853220 us; error 50 us; skew 500 ppm
Aug 10 21:08:47 dist-test-slave-jq4t krb5kdc[16363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396127, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:47.855860 16389 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 21:08:47.856408 16389 webserver.cc:460] Webserver started at http://127.0.0.1:42535/ using document root <none> and password file <none>
I20260810 21:08:47.856698 16389 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:47.856774 16389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:47.856935 16389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:47.858101 16389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "989f97fd95ea4abc9b2c88c9e74fd140"
format_stamp: "Formatted at 2026-08-10 21:08:47 on dist-test-slave-jq4t"
server_key: "13483af69e3a8bf76f852da8154536eb"
server_key_iv: "cfa34a850e29ed85cd087f6b7359eee8"
server_key_version: "encryptionkey@0"
I20260810 21:08:47.858503 16389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "989f97fd95ea4abc9b2c88c9e74fd140"
format_stamp: "Formatted at 2026-08-10 21:08:47 on dist-test-slave-jq4t"
server_key: "13483af69e3a8bf76f852da8154536eb"
server_key_iv: "cfa34a850e29ed85cd087f6b7359eee8"
server_key_version: "encryptionkey@0"
I20260810 21:08:47.860122 16389 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:08:47.861171 16413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:47.861414 16389 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:08:47.861557 16389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "989f97fd95ea4abc9b2c88c9e74fd140"
format_stamp: "Formatted at 2026-08-10 21:08:47 on dist-test-slave-jq4t"
server_key: "13483af69e3a8bf76f852da8154536eb"
server_key_iv: "cfa34a850e29ed85cd087f6b7359eee8"
server_key_version: "encryptionkey@0"
I20260810 21:08:47.861645 16389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:47.873400 16389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:47.875628 16389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:47.875823 16389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:47.880293 16389 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45129
I20260810 21:08:47.880330 16495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45129 every 8 connection(s)
I20260810 21:08:47.880784 16389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:47.881791 16496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:47.884249 16496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140: Bootstrap starting.
I20260810 21:08:47.884949 16496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:47.885218 16496 log.cc:824] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:47.885972 16496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140: No bootstrap required, opened a new log
I20260810 21:08:47.887633 16496 raft_consensus.cc:348] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "989f97fd95ea4abc9b2c88c9e74fd140" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } }
I20260810 21:08:47.887790 16496 raft_consensus.cc:374] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:47.887814 16496 raft_consensus.cc:729] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 989f97fd95ea4abc9b2c88c9e74fd140, State: Initialized, Role: FOLLOWER
I20260810 21:08:47.888015 16496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "989f97fd95ea4abc9b2c88c9e74fd140" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } }
I20260810 21:08:47.888142 16496 raft_consensus.cc:388] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:47.888211 16496 raft_consensus.cc:482] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:47.888264 16496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:47.888873 16496 raft_consensus.cc:504] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "989f97fd95ea4abc9b2c88c9e74fd140" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } }
I20260810 21:08:47.888974 16496 leader_election.cc:302] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 989f97fd95ea4abc9b2c88c9e74fd140; no voters:
I20260810 21:08:47.889117 16496 leader_election.cc:288] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:47.889281 16501 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:47.889420 16496 sys_catalog.cc:564] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:47.889514 16501 raft_consensus.cc:686] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [term 1 LEADER]: Becoming Leader. State: Replica: 989f97fd95ea4abc9b2c88c9e74fd140, State: Running, Role: LEADER
I20260810 21:08:47.889550 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 16389
I20260810 21:08:47.889685 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:47.889657 16501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "989f97fd95ea4abc9b2c88c9e74fd140" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } }
I20260810 21:08:47.889918 15508 external_mini_cluster.cc:1428] Setting key 396210dcb410a1dd45af07823f6f1cc1
I20260810 21:08:47.891194 16502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "989f97fd95ea4abc9b2c88c9e74fd140" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "989f97fd95ea4abc9b2c88c9e74fd140" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } } }
I20260810 21:08:47.891263 16502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:47.891011 16503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 989f97fd95ea4abc9b2c88c9e74fd140. Latest consensus state: current_term: 1 leader_uuid: "989f97fd95ea4abc9b2c88c9e74fd140" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "989f97fd95ea4abc9b2c88c9e74fd140" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45129 } } }
I20260810 21:08:47.891508 16503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140 [sys.catalog]: This master's current role is: LEADER
W20260810 21:08:47.891602 16529 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:08:47.891652 16529 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:08:47.891726 16531 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:47.891891 16531 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:47.894198 16531 catalog_manager.cc:1347] Generated new cluster ID: fd0b3e42a8564a619e71db9cd8dfc6d5
I20260810 21:08:47.894254 16531 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:08:47 dist-test-slave-jq4t krb5kdc[16363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396127, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 21:08:47.904328 16519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:47.890523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39361 (local address 127.0.0.1:45129)
0810 21:08:47.890747 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:47.890759 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:47.890801 (+ 42us) server_negotiation.cc:407] Connection header received
0810 21:08:47.892013 (+ 1212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:47.892022 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:47.892088 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:47.892240 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:47.893097 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:47.894592 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:47.895768 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:47.896418 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:47.896574 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:47.899764 (+ 3190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:47.899771 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:47.899771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:47.899787 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:47.901975 (+ 2188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:47.902466 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:47.902470 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:47.902471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:47.902610 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:47.902839 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:47.902840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:47.902840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:47.903218 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:47.903815 (+ 597us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:47.903894 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 21:08:47.904067 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":104,"threads_started":1}
I20260810 21:08:47.905609 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:08:47.914870 16519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:47.907159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40415 (local address 127.0.0.1:45129)
0810 21:08:47.907198 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:47.907200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:47.907251 (+ 51us) server_negotiation.cc:407] Connection header received
0810 21:08:47.907311 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:47.907312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:47.907323 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:47.907379 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:47.907997 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:47.908864 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:47.909882 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:47.910240 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:47.910316 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:47.911756 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:47.911758 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:47.911758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:47.911766 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:47.913501 (+ 1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:47.913906 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:47.913908 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:47.913908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:47.913979 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:47.914213 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:47.914214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:47.914214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:47.914402 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:47.914505 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:47.914665 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 21:08:47.914760 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":19}
I20260810 21:08:47.915592 16531 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:47.916306 16531 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:47.933708 16531 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 989f97fd95ea4abc9b2c88c9e74fd140: Generated new TSK 0
I20260810 21:08:47.933997 16531 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:47.941490 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 16389
2026-08-10T21:08:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1610 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:48 dist-test-slave-jq4t krb5kdc[16548](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:48 dist-test-slave-jq4t krb5kdc[16548](info): set up 2 sockets
Aug 10 21:08:48 dist-test-slave-jq4t krb5kdc[16548](info): commencing operation
krb5kdc: starting...
W20260810 21:08:49.223143 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:49 dist-test-slave-jq4t krb5kdc[16548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 21:08:49.356741 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38097
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38097
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:49.450742 16570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:49.451064 16570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:49.451112 16570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:49.452407 16570 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:49.452497 16570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:49.452574 16570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:49.452597 16570 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:49.452626 16570 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:49.454320 16570 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38097
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38097
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:49.454668 16570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:49.454958 16570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:49.460577 16578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:49.460716 16570 server_base.cc:1034] running on GCE node
W20260810 21:08:49.460536 16580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:49.460559 16577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:49.461231 16570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:49.461582 16570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:49.462766 16570 hybrid_clock.cc:648] HybridClock initialized: now 1786396129462754 us; error 49 us; skew 500 ppm
Aug 10 21:08:49 dist-test-slave-jq4t krb5kdc[16548](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396129, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:49.469261 16570 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 21:08:49.469827 16570 webserver.cc:460] Webserver started at http://127.0.0.1:46221/ using document root <none> and password file <none>
I20260810 21:08:49.470108 16570 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:49.470158 16570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:49.470345 16570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:49.471585 16570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "4459b3eb384c4d0580a563b73823a403"
format_stamp: "Formatted at 2026-08-10 21:08:49 on dist-test-slave-jq4t"
server_key: "b5265484cc1678cec62378698c42eab3"
server_key_iv: "21750e58db28411a7b2d7890ae1fa3fd"
server_key_version: "encryptionkey@0"
I20260810 21:08:49.471995 16570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "4459b3eb384c4d0580a563b73823a403"
format_stamp: "Formatted at 2026-08-10 21:08:49 on dist-test-slave-jq4t"
server_key: "b5265484cc1678cec62378698c42eab3"
server_key_iv: "21750e58db28411a7b2d7890ae1fa3fd"
server_key_version: "encryptionkey@0"
I20260810 21:08:49.473670 16570 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260810 21:08:49.474632 16590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:49.474941 16570 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:08:49.475066 16570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "4459b3eb384c4d0580a563b73823a403"
format_stamp: "Formatted at 2026-08-10 21:08:49 on dist-test-slave-jq4t"
server_key: "b5265484cc1678cec62378698c42eab3"
server_key_iv: "21750e58db28411a7b2d7890ae1fa3fd"
server_key_version: "encryptionkey@0"
I20260810 21:08:49.475152 16570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:49.495091 16570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:49.497635 16570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:49.497829 16570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:49.502439 16570 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38097
I20260810 21:08:49.502496 16677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38097 every 8 connection(s)
I20260810 21:08:49.502949 16570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:49.503949 16678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:49.506433 16678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403: Bootstrap starting.
I20260810 21:08:49.506628 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 16570
I20260810 21:08:49.506778 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:49.507021 15508 external_mini_cluster.cc:1428] Setting key 9f0c7eaee63c52e4ec095243a668c099
I20260810 21:08:49.507297 16678 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:49.507696 16678 log.cc:824] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:49.508563 16678 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403: No bootstrap required, opened a new log
I20260810 21:08:49.510459 16678 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4459b3eb384c4d0580a563b73823a403" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38097 } }
I20260810 21:08:49.510640 16678 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:49.510692 16678 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4459b3eb384c4d0580a563b73823a403, State: Initialized, Role: FOLLOWER
I20260810 21:08:49.510849 16678 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4459b3eb384c4d0580a563b73823a403" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38097 } }
I20260810 21:08:49.510949 16678 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:49.510983 16678 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:49.511022 16678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:49.511838 16678 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4459b3eb384c4d0580a563b73823a403" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38097 } }
I20260810 21:08:49.511981 16678 leader_election.cc:302] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4459b3eb384c4d0580a563b73823a403; no voters:
I20260810 21:08:49.512202 16678 leader_election.cc:288] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:49.512250 16686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:49.512444 16686 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [term 1 LEADER]: Becoming Leader. State: Replica: 4459b3eb384c4d0580a563b73823a403, State: Running, Role: LEADER
I20260810 21:08:49.512542 16678 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:49.512571 16686 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4459b3eb384c4d0580a563b73823a403" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38097 } }
I20260810 21:08:49.512907 16686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4459b3eb384c4d0580a563b73823a403. Latest consensus state: current_term: 1 leader_uuid: "4459b3eb384c4d0580a563b73823a403" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4459b3eb384c4d0580a563b73823a403" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38097 } } }
I20260810 21:08:49.513001 16686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:49.512920 16690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4459b3eb384c4d0580a563b73823a403" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4459b3eb384c4d0580a563b73823a403" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38097 } } }
I20260810 21:08:49.513132 16690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:49.513239 16697 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:49.513761 16697 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:49.515291 16683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:49.507663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40579 (local address 127.0.0.1:38097)
0810 21:08:49.507882 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:49.507892 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:49.507927 (+ 35us) server_negotiation.cc:407] Connection header received
0810 21:08:49.508426 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:49.508433 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:49.508544 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:49.508716 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:49.508974 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:49.509940 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:49.510827 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:49.511499 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:49.511631 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:49.514507 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:49.514512 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:49.514512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:49.514735 (+ 223us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:49.514778 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:49.514795 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:49.514870 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:49.514979 (+ 109us) server_negotiation.cc:299] Negotiation successful
0810 21:08:49.515055 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":84,"threads_started":1}
I20260810 21:08:49.515779 16697 catalog_manager.cc:1347] Generated new cluster ID: 11c3d2bf65fe4e5491faa6fbf93aef15
I20260810 21:08:49.515826 16697 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:08:49.516397 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:08:49.528825 16683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:49.520886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47935 (local address 127.0.0.1:38097)
0810 21:08:49.520943 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:49.520945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:49.524762 (+ 3817us) server_negotiation.cc:407] Connection header received
0810 21:08:49.524832 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:49.524834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:49.524850 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:49.524934 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:49.525106 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:49.525925 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:49.527000 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:49.527345 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:49.527434 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:49.528372 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:49.528373 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:49.528374 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:49.528380 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:49.528400 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:49.528405 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:49.528501 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:49.528695 (+ 194us) server_negotiation.cc:299] Negotiation successful
0810 21:08:49.528727 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 21:08:49.528936 16697 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:49.529707 16697 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:49.532835 16697 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4459b3eb384c4d0580a563b73823a403: Generated new TSK 0
I20260810 21:08:49.533090 16697 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:49.537317 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 16570
2026-08-10T21:08:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1611 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:49 dist-test-slave-jq4t krb5kdc[16726](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:49 dist-test-slave-jq4t krb5kdc[16726](info): set up 2 sockets
Aug 10 21:08:49 dist-test-slave-jq4t krb5kdc[16726](info): commencing operation
krb5kdc: starting...
W20260810 21:08:50.856457 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:50 dist-test-slave-jq4t krb5kdc[16726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 21:08:50.991750 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33263
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:51.079999 16751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:51.080232 16751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:51.080258 16751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:51.081542 16751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:51.081597 16751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:51.081611 16751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:51.081624 16751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:51.081637 16751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:51.083256 16751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33263
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:51.083570 16751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:51.083840 16751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:51.089596 16758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:51.089658 16762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:51.089823 16751 server_base.cc:1034] running on GCE node
W20260810 21:08:51.089665 16759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:51.090204 16751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:51.090543 16751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:51.091718 16751 hybrid_clock.cc:648] HybridClock initialized: now 1786396131091698 us; error 31 us; skew 500 ppm
Aug 10 21:08:51 dist-test-slave-jq4t krb5kdc[16726](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396131, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:51.094851 16751 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 21:08:51.095317 16751 webserver.cc:460] Webserver started at http://127.0.0.1:35987/ using document root <none> and password file <none>
I20260810 21:08:51.095522 16751 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:51.095564 16751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:51.095664 16751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:51.096959 16751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "735902cae856485aa86799d419cfcdb5"
format_stamp: "Formatted at 2026-08-10 21:08:51 on dist-test-slave-jq4t"
server_key: "9916aa59363164cdb265621a2d187ba2"
server_key_iv: "82391322661a7ea1b7049bf9c30868b3"
server_key_version: "encryptionkey@0"
I20260810 21:08:51.097295 16751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "735902cae856485aa86799d419cfcdb5"
format_stamp: "Formatted at 2026-08-10 21:08:51 on dist-test-slave-jq4t"
server_key: "9916aa59363164cdb265621a2d187ba2"
server_key_iv: "82391322661a7ea1b7049bf9c30868b3"
server_key_version: "encryptionkey@0"
I20260810 21:08:51.098726 16751 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:08:51.099583 16771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:51.099841 16751 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:51.099964 16751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "735902cae856485aa86799d419cfcdb5"
format_stamp: "Formatted at 2026-08-10 21:08:51 on dist-test-slave-jq4t"
server_key: "9916aa59363164cdb265621a2d187ba2"
server_key_iv: "82391322661a7ea1b7049bf9c30868b3"
server_key_version: "encryptionkey@0"
I20260810 21:08:51.100054 16751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:51.103719 16751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:51.106004 16751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:51.106184 16751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:51.111158 16751 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33263
I20260810 21:08:51.111194 16855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33263 every 8 connection(s)
I20260810 21:08:51.111615 16751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:51.112800 16858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:51.115329 16858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5: Bootstrap starting.
I20260810 21:08:51.115972 16858 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:51.116236 16858 log.cc:824] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:51.117130 16858 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5: No bootstrap required, opened a new log
I20260810 21:08:51.118633 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 16751
I20260810 21:08:51.118781 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:51.119001 15508 external_mini_cluster.cc:1428] Setting key b33c80731c1b4ee7984f483007325188
I20260810 21:08:51.119403 16858 raft_consensus.cc:348] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735902cae856485aa86799d419cfcdb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33263 } }
I20260810 21:08:51.119647 16858 raft_consensus.cc:374] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:51.119745 16858 raft_consensus.cc:729] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735902cae856485aa86799d419cfcdb5, State: Initialized, Role: FOLLOWER
I20260810 21:08:51.119939 16858 consensus_queue.cc:260] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735902cae856485aa86799d419cfcdb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33263 } }
I20260810 21:08:51.120054 16858 raft_consensus.cc:388] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:51.120106 16858 raft_consensus.cc:482] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:51.120163 16858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:51.121663 16864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:51.119655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37643 (local address 127.0.0.1:33263)
0810 21:08:51.119848 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:51.119859 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:51.119897 (+ 38us) server_negotiation.cc:407] Connection header received
0810 21:08:51.120066 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:51.120092 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:51.120127 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:51.120273 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:51.121112 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:51.121117 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:51.121117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:51.121122 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:51.121169 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:51.121181 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:51.121247 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:51.121370 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 21:08:51.121455 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":97,"threads_started":1}
I20260810 21:08:51.121884 16858 raft_consensus.cc:504] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735902cae856485aa86799d419cfcdb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33263 } }
I20260810 21:08:51.122015 16858 leader_election.cc:302] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 735902cae856485aa86799d419cfcdb5; no voters:
I20260810 21:08:51.122269 16858 leader_election.cc:288] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:51.122299 16865 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:51.122416 16865 raft_consensus.cc:686] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [term 1 LEADER]: Becoming Leader. State: Replica: 735902cae856485aa86799d419cfcdb5, State: Running, Role: LEADER
I20260810 21:08:51.122584 16858 sys_catalog.cc:564] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:51.122599 16865 consensus_queue.cc:237] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735902cae856485aa86799d419cfcdb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33263 } }
I20260810 21:08:51.122808 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:08:51.123113 16869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 735902cae856485aa86799d419cfcdb5. Latest consensus state: current_term: 1 leader_uuid: "735902cae856485aa86799d419cfcdb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735902cae856485aa86799d419cfcdb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33263 } } }
I20260810 21:08:51.123219 16869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:51.123476 16871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "735902cae856485aa86799d419cfcdb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "735902cae856485aa86799d419cfcdb5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33263 } } }
I20260810 21:08:51.123840 16871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:51.124073 16877 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:51.124763 16877 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:51.126065 16864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:51.124629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34209 (local address 127.0.0.1:33263)
0810 21:08:51.124672 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:51.124674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:51.124865 (+ 191us) server_negotiation.cc:407] Connection header received
0810 21:08:51.124997 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:51.124998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:51.125005 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:51.125079 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:51.125821 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:51.125823 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:51.125824 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:51.125829 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:51.125850 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:51.125854 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:51.125921 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:51.125987 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 21:08:51.126004 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 21:08:51.126945 16877 catalog_manager.cc:1347] Generated new cluster ID: d98145ef55d4475dafd41ea0180ef827
I20260810 21:08:51.127012 16877 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:08:51.147415 16877 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:51.147660 16877 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:51.150460 16877 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 735902cae856485aa86799d419cfcdb5: Generated new TSK 0
I20260810 21:08:51.150730 16877 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:51.156145 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 16751
2026-08-10T21:08:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1609 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:51 dist-test-slave-jq4t krb5kdc[16909](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:51 dist-test-slave-jq4t krb5kdc[16909](info): set up 2 sockets
Aug 10 21:08:51 dist-test-slave-jq4t krb5kdc[16909](info): commencing operation
krb5kdc: starting...
W20260810 21:08:52.450145 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.262s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:52 dist-test-slave-jq4t krb5kdc[16909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 21:08:52.591764 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42899
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35907
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:52.679965 16940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:52.680195 16940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:52.680220 16940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:52.681450 16940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:52.681499 16940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:52.681514 16940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:52.681526 16940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:52.681538 16940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:52.683070 16940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35907
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:52.683297 16940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:52.683501 16940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:52.689375 16953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:52.689375 16950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:52.689447 16949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:52.689692 16940 server_base.cc:1034] running on GCE node
I20260810 21:08:52.689980 16940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:52.690279 16940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:52.691458 16940 hybrid_clock.cc:648] HybridClock initialized: now 1786396132691423 us; error 40 us; skew 500 ppm
Aug 10 21:08:52 dist-test-slave-jq4t krb5kdc[16909](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396132, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:52.694634 16940 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 21:08:52.695140 16940 webserver.cc:460] Webserver started at http://127.0.0.1:37773/ using document root <none> and password file <none>
I20260810 21:08:52.695382 16940 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:52.695430 16940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:52.695533 16940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:52.696766 16940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "58700ec79729422aa73bea9e5e99a4ba"
format_stamp: "Formatted at 2026-08-10 21:08:52 on dist-test-slave-jq4t"
server_key: "4dd5315576a95651b5b26bf1f5c3a65c"
server_key_iv: "1b66baee14fdb6cc57c1099b5f9aa841"
server_key_version: "encryptionkey@0"
I20260810 21:08:52.697113 16940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "58700ec79729422aa73bea9e5e99a4ba"
format_stamp: "Formatted at 2026-08-10 21:08:52 on dist-test-slave-jq4t"
server_key: "4dd5315576a95651b5b26bf1f5c3a65c"
server_key_iv: "1b66baee14fdb6cc57c1099b5f9aa841"
server_key_version: "encryptionkey@0"
I20260810 21:08:52.698676 16940 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:08:52.699563 16960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:52.699805 16940 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:52.699918 16940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "58700ec79729422aa73bea9e5e99a4ba"
format_stamp: "Formatted at 2026-08-10 21:08:52 on dist-test-slave-jq4t"
server_key: "4dd5315576a95651b5b26bf1f5c3a65c"
server_key_iv: "1b66baee14fdb6cc57c1099b5f9aa841"
server_key_version: "encryptionkey@0"
I20260810 21:08:52.699991 16940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:52.723990 16940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:52.726477 16940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:52.726636 16940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:52.731127 16940 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42899
I20260810 21:08:52.731204 17046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42899 every 8 connection(s)
I20260810 21:08:52.731582 16940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:52.732720 17049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:52.735208 17049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba: Bootstrap starting.
I20260810 21:08:52.735810 17049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:52.736069 17049 log.cc:824] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:52.736894 17049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba: No bootstrap required, opened a new log
I20260810 21:08:52.738541 17049 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58700ec79729422aa73bea9e5e99a4ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42899 } }
I20260810 21:08:52.738801 17049 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:52.738848 17049 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58700ec79729422aa73bea9e5e99a4ba, State: Initialized, Role: FOLLOWER
I20260810 21:08:52.738834 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 16940
I20260810 21:08:52.738972 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:52.739024 17049 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58700ec79729422aa73bea9e5e99a4ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42899 } }
I20260810 21:08:52.739123 17049 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:52.739158 17049 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:52.739187 15508 external_mini_cluster.cc:1428] Setting key 67ff1b7f5c837c7b9f9841dbdfe98c76
I20260810 21:08:52.739213 17049 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:52.739886 17049 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58700ec79729422aa73bea9e5e99a4ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42899 } }
I20260810 21:08:52.740087 17049 leader_election.cc:302] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58700ec79729422aa73bea9e5e99a4ba; no voters:
I20260810 21:08:52.740283 17049 leader_election.cc:288] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:52.740331 17056 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:52.740563 17056 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [term 1 LEADER]: Becoming Leader. State: Replica: 58700ec79729422aa73bea9e5e99a4ba, State: Running, Role: LEADER
I20260810 21:08:52.740633 17049 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:52.740710 17056 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58700ec79729422aa73bea9e5e99a4ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42899 } }
I20260810 21:08:52.741228 17058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58700ec79729422aa73bea9e5e99a4ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58700ec79729422aa73bea9e5e99a4ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42899 } } }
I20260810 21:08:52.741317 17058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:52.741488 17059 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58700ec79729422aa73bea9e5e99a4ba. Latest consensus state: current_term: 1 leader_uuid: "58700ec79729422aa73bea9e5e99a4ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58700ec79729422aa73bea9e5e99a4ba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42899 } } }
I20260810 21:08:52.741571 17059 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:52.742182 17061 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:52.742877 17061 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:52.744998 17061 catalog_manager.cc:1347] Generated new cluster ID: 2119f342a09c4f31a1df08d339e993d0
I20260810 21:08:52.745077 17061 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:08:52 dist-test-slave-jq4t krb5kdc[16909](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 21:08:52.757248 17054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:52.739979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:54183 (local address 127.0.0.1:42899)
0810 21:08:52.740180 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:52.740192 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:52.740236 (+ 44us) server_negotiation.cc:407] Connection header received
0810 21:08:52.740416 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:52.740425 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:52.740532 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:52.741617 (+ 1085us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:52.741742 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:52.743225 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:52.744219 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:52.744859 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:52.748675 (+ 3816us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:52.752406 (+ 3731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:52.752412 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:52.752412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:52.752429 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:52.754896 (+ 2467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:52.755530 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:52.755535 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:52.755535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:52.755682 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:52.755957 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:52.755958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:52.755958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:52.756347 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:52.756550 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:52.756686 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 21:08:52.756952 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":91,"threads_started":1}
I20260810 21:08:52.758714 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:08:52.760797 17061 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:52.761577 17061 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:52.765033 17061 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58700ec79729422aa73bea9e5e99a4ba: Generated new TSK 0
I20260810 21:08:52.765254 17061 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:52.767454 17054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:52.760359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:55083 (local address 127.0.0.1:42899)
0810 21:08:52.760404 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:52.760406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:52.760576 (+ 170us) server_negotiation.cc:407] Connection header received
0810 21:08:52.760679 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:52.760680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:52.760690 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:52.760724 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:52.761387 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:52.761969 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:52.762683 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:52.762922 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:52.763006 (+ 84us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:52.764360 (+ 1354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:52.764362 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:52.764362 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:52.764370 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:52.766080 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:52.766537 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:52.766538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:52.766538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:52.766606 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:52.766866 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:52.766867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:52.766867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:52.766999 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:52.767150 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:52.767273 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 21:08:52.767345 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 21:08:52.769835 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 16940
W20260810 21:08:52.786911 16904 connection.cc:535] client connection to 127.0.0.1:42899 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42899): Connection reset by peer (error 104)
2026-08-10T21:08:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1613 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:52 dist-test-slave-jq4t krb5kdc[17089](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:52 dist-test-slave-jq4t krb5kdc[17089](info): set up 2 sockets
Aug 10 21:08:52 dist-test-slave-jq4t krb5kdc[17089](info): commencing operation
krb5kdc: starting...
W20260810 21:08:54.057034 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:54 dist-test-slave-jq4t krb5kdc[17089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396134, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 21:08:54.192206 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36645
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36645
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:54.281503 17108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:54.281739 17108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:54.281764 17108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:54.282984 17108 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:54.283030 17108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:54.283046 17108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:54.283087 17108 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:54.283114 17108 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:54.284787 17108 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36645
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:54.285072 17108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:54.285317 17108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:54.291046 17122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:54.291057 17120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:54.291057 17118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:54.291495 17108 server_base.cc:1034] running on GCE node
I20260810 21:08:54.291788 17108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:54.292132 17108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:54.293315 17108 hybrid_clock.cc:648] HybridClock initialized: now 1786396134293285 us; error 42 us; skew 500 ppm
Aug 10 21:08:54 dist-test-slave-jq4t krb5kdc[17089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396134, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:54.296315 17108 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 21:08:54.296972 17108 webserver.cc:460] Webserver started at http://127.0.0.1:42821/ using document root <none> and password file <none>
I20260810 21:08:54.297248 17108 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:54.297325 17108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:54.297497 17108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:54.298691 17108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "791004e6637848629e6a2f87299973ec"
format_stamp: "Formatted at 2026-08-10 21:08:54 on dist-test-slave-jq4t"
server_key: "cf7fbfcfb1ebc9623de85de414113081"
server_key_iv: "be26cb32874b066c65bf6d85e92386bb"
server_key_version: "encryptionkey@0"
I20260810 21:08:54.299094 17108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "791004e6637848629e6a2f87299973ec"
format_stamp: "Formatted at 2026-08-10 21:08:54 on dist-test-slave-jq4t"
server_key: "cf7fbfcfb1ebc9623de85de414113081"
server_key_iv: "be26cb32874b066c65bf6d85e92386bb"
server_key_version: "encryptionkey@0"
I20260810 21:08:54.300603 17108 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:08:54.301460 17140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:54.301646 17108 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:54.301760 17108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "791004e6637848629e6a2f87299973ec"
format_stamp: "Formatted at 2026-08-10 21:08:54 on dist-test-slave-jq4t"
server_key: "cf7fbfcfb1ebc9623de85de414113081"
server_key_iv: "be26cb32874b066c65bf6d85e92386bb"
server_key_version: "encryptionkey@0"
I20260810 21:08:54.301841 17108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:54.345012 17108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:54.347797 17108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:54.348007 17108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:54.352754 17108 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36645
I20260810 21:08:54.352803 17229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36645 every 8 connection(s)
I20260810 21:08:54.353528 17108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:54.354853 17231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:54.357532 17231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec: Bootstrap starting.
I20260810 21:08:54.358181 17231 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:54.358434 17231 log.cc:824] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:54.359272 17231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec: No bootstrap required, opened a new log
I20260810 21:08:54.359381 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 17108
I20260810 21:08:54.359532 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:54.359750 15508 external_mini_cluster.cc:1428] Setting key e55595e59bc1e34817c277ce3e3b1aab
I20260810 21:08:54.361961 17231 raft_consensus.cc:348] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "791004e6637848629e6a2f87299973ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36645 } }
I20260810 21:08:54.362206 17231 raft_consensus.cc:374] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:54.362244 17231 raft_consensus.cc:729] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 791004e6637848629e6a2f87299973ec, State: Initialized, Role: FOLLOWER
I20260810 21:08:54.362377 17231 consensus_queue.cc:260] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "791004e6637848629e6a2f87299973ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36645 } }
I20260810 21:08:54.362470 17231 raft_consensus.cc:388] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:54.362505 17231 raft_consensus.cc:482] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:54.362556 17231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:54.363387 17231 raft_consensus.cc:504] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "791004e6637848629e6a2f87299973ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36645 } }
I20260810 21:08:54.363507 17231 leader_election.cc:302] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 791004e6637848629e6a2f87299973ec; no voters:
I20260810 21:08:54.363685 17231 leader_election.cc:288] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:54.363785 17237 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:54.363981 17237 raft_consensus.cc:686] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [term 1 LEADER]: Becoming Leader. State: Replica: 791004e6637848629e6a2f87299973ec, State: Running, Role: LEADER
I20260810 21:08:54.363966 17231 sys_catalog.cc:564] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:54.364133 17237 consensus_queue.cc:237] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "791004e6637848629e6a2f87299973ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36645 } }
I20260810 21:08:54.364514 17239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "791004e6637848629e6a2f87299973ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "791004e6637848629e6a2f87299973ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36645 } } }
I20260810 21:08:54.364674 17239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:54.364969 17255 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:54.365356 17240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 791004e6637848629e6a2f87299973ec. Latest consensus state: current_term: 1 leader_uuid: "791004e6637848629e6a2f87299973ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "791004e6637848629e6a2f87299973ec" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36645 } } }
I20260810 21:08:54.365514 17240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:54.366065 17255 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:54.367877 17236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:54.360382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:52885 (local address 127.0.0.1:36645)
0810 21:08:54.360617 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:54.360627 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:54.360664 (+ 37us) server_negotiation.cc:407] Connection header received
0810 21:08:54.362152 (+ 1488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:54.362163 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:54.362240 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:54.362421 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:54.362695 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:54.364069 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:54.365425 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:54.366098 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:54.366638 (+ 540us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:54.367062 (+ 424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:54.367068 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:54.367068 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:54.367339 (+ 271us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:54.367384 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:54.367398 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:54.367507 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:54.367592 (+ 85us) server_negotiation.cc:299] Negotiation successful
0810 21:08:54.367622 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":126,"threads_started":1}
I20260810 21:08:54.367883 17255 catalog_manager.cc:1347] Generated new cluster ID: 7d6744be19114b9fb99396d96239e09c
I20260810 21:08:54.367954 17255 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:08:54.369063 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:08:54.376348 17236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:54.370625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:45363 (local address 127.0.0.1:36645)
0810 21:08:54.370663 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:54.370664 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:54.372704 (+ 2040us) server_negotiation.cc:407] Connection header received
0810 21:08:54.372779 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:54.372780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:54.372793 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:54.372844 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:54.372999 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:54.373728 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:54.374817 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:54.375136 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:54.375200 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:54.376050 (+ 850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:54.376052 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:54.376052 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:54.376057 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:54.376074 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:54.376078 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:54.376133 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:54.376245 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 21:08:54.376256 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 21:08:54.383752 17255 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:54.384331 17255 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:54.395323 17255 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 791004e6637848629e6a2f87299973ec: Generated new TSK 0
I20260810 21:08:54.395608 17255 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:54.401400 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 17108
W20260810 21:08:54.424579 17087 connection.cc:535] client connection to 127.0.0.1:36645 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36645): Connection reset by peer (error 104)
2026-08-10T21:08:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1637 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:54 dist-test-slave-jq4t krb5kdc[17285](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:54 dist-test-slave-jq4t krb5kdc[17285](info): set up 2 sockets
Aug 10 21:08:54 dist-test-slave-jq4t krb5kdc[17285](info): commencing operation
krb5kdc: starting...
W20260810 21:08:55.686214 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:55 dist-test-slave-jq4t krb5kdc[17285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396135, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 21:08:55.823156 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41573
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:55.909551 17309 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:55.909780 17309 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:55.909804 17309 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:55.911064 17309 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:55.911118 17309 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:55.911132 17309 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:55.911144 17309 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:55.911157 17309 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:55.912946 17309 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17309
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:55.913252 17309 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:55.913529 17309 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:55.918905 17320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:55.918906 17317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:55.918929 17315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:55.919142 17309 server_base.cc:1034] running on GCE node
I20260810 21:08:55.919440 17309 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:55.919823 17309 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:55.920977 17309 hybrid_clock.cc:648] HybridClock initialized: now 1786396135920948 us; error 44 us; skew 500 ppm
Aug 10 21:08:55 dist-test-slave-jq4t krb5kdc[17285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396135, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:55.927241 17309 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 21:08:55.927932 17309 webserver.cc:460] Webserver started at http://127.0.0.1:43073/ using document root <none> and password file <none>
I20260810 21:08:55.928274 17309 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:55.928360 17309 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:55.928550 17309 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:55.930377 17309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "e54245681f69402b822f58fdf65370b7"
format_stamp: "Formatted at 2026-08-10 21:08:55 on dist-test-slave-jq4t"
server_key: "6e13b79ef39814a24c35ca0c28210b95"
server_key_iv: "9c62f9d800a74eef1e26d7ce20898c93"
server_key_version: "encryptionkey@0"
I20260810 21:08:55.930775 17309 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "e54245681f69402b822f58fdf65370b7"
format_stamp: "Formatted at 2026-08-10 21:08:55 on dist-test-slave-jq4t"
server_key: "6e13b79ef39814a24c35ca0c28210b95"
server_key_iv: "9c62f9d800a74eef1e26d7ce20898c93"
server_key_version: "encryptionkey@0"
I20260810 21:08:55.932307 17309 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:08:55.933234 17336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:55.933426 17309 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:08:55.933516 17309 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "e54245681f69402b822f58fdf65370b7"
format_stamp: "Formatted at 2026-08-10 21:08:55 on dist-test-slave-jq4t"
server_key: "6e13b79ef39814a24c35ca0c28210b95"
server_key_iv: "9c62f9d800a74eef1e26d7ce20898c93"
server_key_version: "encryptionkey@0"
I20260810 21:08:55.933580 17309 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:55.937189 17309 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:55.939605 17309 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:55.939733 17309 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:55.944376 17309 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41573
I20260810 21:08:55.944455 17416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41573 every 8 connection(s)
I20260810 21:08:55.944893 17309 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:55.946159 17422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:55.948819 17422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7: Bootstrap starting.
I20260810 21:08:55.949235 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 17309
I20260810 21:08:55.949357 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:55.949575 15508 external_mini_cluster.cc:1428] Setting key 44399db4d9b23e88661fe026020b21bf
I20260810 21:08:55.949765 17422 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:55.950213 17422 log.cc:824] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:55.951327 17422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7: No bootstrap required, opened a new log
I20260810 21:08:55.953223 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:55.950255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:57769 (local address 127.0.0.1:41573)
0810 21:08:55.950502 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:55.950512 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:55.950552 (+ 40us) server_negotiation.cc:407] Connection header received
0810 21:08:55.951135 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:55.951143 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:55.951173 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:55.951369 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:55.952259 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:55.952264 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:55.952264 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:55.952269 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:55.952327 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:55.952347 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:55.952718 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:55.952758 (+ 40us) server_negotiation.cc:299] Negotiation successful
0810 21:08:55.952809 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":112,"threads_started":1}
I20260810 21:08:55.953996 17422 raft_consensus.cc:348] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54245681f69402b822f58fdf65370b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41573 } }
I20260810 21:08:55.954228 17422 raft_consensus.cc:374] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:55.954282 17422 raft_consensus.cc:729] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e54245681f69402b822f58fdf65370b7, State: Initialized, Role: FOLLOWER
I20260810 21:08:55.954443 17422 consensus_queue.cc:260] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54245681f69402b822f58fdf65370b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41573 } }
I20260810 21:08:55.954557 17422 raft_consensus.cc:388] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:55.954578 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:08:55.954607 17422 raft_consensus.cc:482] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:55.954654 17422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:55.955610 17422 raft_consensus.cc:504] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54245681f69402b822f58fdf65370b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41573 } }
I20260810 21:08:55.955757 17422 leader_election.cc:302] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e54245681f69402b822f58fdf65370b7; no voters:
I20260810 21:08:55.955967 17422 leader_election.cc:288] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:55.956009 17435 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:55.956276 17422 sys_catalog.cc:564] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:55.956597 17435 raft_consensus.cc:686] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [term 1 LEADER]: Becoming Leader. State: Replica: e54245681f69402b822f58fdf65370b7, State: Running, Role: LEADER
I20260810 21:08:55.956737 17435 consensus_queue.cc:237] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54245681f69402b822f58fdf65370b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41573 } }
I20260810 21:08:55.957257 17442 sys_catalog.cc:455] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e54245681f69402b822f58fdf65370b7. Latest consensus state: current_term: 1 leader_uuid: "e54245681f69402b822f58fdf65370b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54245681f69402b822f58fdf65370b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41573 } } }
I20260810 21:08:55.957357 17442 sys_catalog.cc:458] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:55.957736 17440 sys_catalog.cc:455] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e54245681f69402b822f58fdf65370b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e54245681f69402b822f58fdf65370b7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41573 } } }
I20260810 21:08:55.957811 17440 sys_catalog.cc:458] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7 [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:55.958127 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:55.956400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:58679 (local address 127.0.0.1:41573)
0810 21:08:55.956443 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:55.956445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:55.956762 (+ 317us) server_negotiation.cc:407] Connection header received
0810 21:08:55.956935 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:55.956936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:55.956943 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:55.956978 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:55.957850 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:55.957852 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:55.957852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:55.957857 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:55.957875 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:55.957881 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:55.957943 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:55.958048 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 21:08:55.958065 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 21:08:55.957609 17456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:55.958974 17456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:55.960661 17456 catalog_manager.cc:1347] Generated new cluster ID: d12057f743fe4695b1397b091c003056
I20260810 21:08:55.960748 17456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:08:55.966225 17456 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:55.966497 17456 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:55.969334 17456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e54245681f69402b822f58fdf65370b7: Generated new TSK 0
I20260810 21:08:55.969592 17456 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:55.977640 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 17309
2026-08-10T21:08:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1571 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:56 dist-test-slave-jq4t krb5kdc[17473](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:56 dist-test-slave-jq4t krb5kdc[17473](info): set up 2 sockets
Aug 10 21:08:56 dist-test-slave-jq4t krb5kdc[17473](info): commencing operation
krb5kdc: starting...
W20260810 21:08:57.267125 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:57 dist-test-slave-jq4t krb5kdc[17473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 21:08:57.408346 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37683
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37683
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:57.497673 17490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:57.497908 17490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:57.497936 17490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:57.499720 17490 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:57.499783 17490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:57.499799 17490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:57.499811 17490 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:57.499825 17490 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:57.501592 17490 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37683
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:57.501899 17490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:57.502149 17490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:57.507495 17498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:57.507485 17500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:57.507740 17490 server_base.cc:1034] running on GCE node
W20260810 21:08:57.507485 17506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:57.508101 17490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:57.508548 17490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:57.509722 17490 hybrid_clock.cc:648] HybridClock initialized: now 1786396137509700 us; error 48 us; skew 500 ppm
Aug 10 21:08:57 dist-test-slave-jq4t krb5kdc[17473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396137, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:57.512621 17490 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 21:08:57.513111 17490 webserver.cc:460] Webserver started at http://127.0.0.1:35067/ using document root <none> and password file <none>
I20260810 21:08:57.513361 17490 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:57.513442 17490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:57.513607 17490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:57.514843 17490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "512dd32ef96b4adea333ee6de1cfc19e"
format_stamp: "Formatted at 2026-08-10 21:08:57 on dist-test-slave-jq4t"
server_key: "2fcd6ca8eb12a78dfe91186deea77494"
server_key_iv: "eb90cb0752ae88e097f77b103c1c6f3c"
server_key_version: "encryptionkey@0"
I20260810 21:08:57.515235 17490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "512dd32ef96b4adea333ee6de1cfc19e"
format_stamp: "Formatted at 2026-08-10 21:08:57 on dist-test-slave-jq4t"
server_key: "2fcd6ca8eb12a78dfe91186deea77494"
server_key_iv: "eb90cb0752ae88e097f77b103c1c6f3c"
server_key_version: "encryptionkey@0"
I20260810 21:08:57.516822 17490 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260810 21:08:57.517737 17514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:57.517946 17490 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:08:57.518069 17490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "512dd32ef96b4adea333ee6de1cfc19e"
format_stamp: "Formatted at 2026-08-10 21:08:57 on dist-test-slave-jq4t"
server_key: "2fcd6ca8eb12a78dfe91186deea77494"
server_key_iv: "eb90cb0752ae88e097f77b103c1c6f3c"
server_key_version: "encryptionkey@0"
I20260810 21:08:57.518157 17490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:57.526382 17490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:57.529039 17490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:57.529212 17490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:57.534448 17490 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37683
I20260810 21:08:57.534487 17595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37683 every 8 connection(s)
I20260810 21:08:57.534951 17490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:57.536329 17598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:57.540652 17598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e: Bootstrap starting.
I20260810 21:08:57.541603 17598 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:57.542027 17598 log.cc:824] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:57.543135 17598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e: No bootstrap required, opened a new log
I20260810 21:08:57.545192 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 17490
I20260810 21:08:57.545347 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:57.545574 15508 external_mini_cluster.cc:1428] Setting key 05e74682c1388da7d4bb3247c48d5ebe
I20260810 21:08:57.546599 17598 raft_consensus.cc:348] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "512dd32ef96b4adea333ee6de1cfc19e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37683 } }
I20260810 21:08:57.546849 17598 raft_consensus.cc:374] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:57.546903 17598 raft_consensus.cc:729] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 512dd32ef96b4adea333ee6de1cfc19e, State: Initialized, Role: FOLLOWER
I20260810 21:08:57.547112 17598 consensus_queue.cc:260] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "512dd32ef96b4adea333ee6de1cfc19e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37683 } }
I20260810 21:08:57.547226 17598 raft_consensus.cc:388] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:57.547271 17598 raft_consensus.cc:482] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:57.547333 17598 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:57.548415 17598 raft_consensus.cc:504] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "512dd32ef96b4adea333ee6de1cfc19e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37683 } }
I20260810 21:08:57.548596 17598 leader_election.cc:302] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 512dd32ef96b4adea333ee6de1cfc19e; no voters:
I20260810 21:08:57.548823 17598 leader_election.cc:288] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:57.548933 17606 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:57.549129 17606 raft_consensus.cc:686] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [term 1 LEADER]: Becoming Leader. State: Replica: 512dd32ef96b4adea333ee6de1cfc19e, State: Running, Role: LEADER
I20260810 21:08:57.549173 17598 sys_catalog.cc:564] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:57.549296 17606 consensus_queue.cc:237] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "512dd32ef96b4adea333ee6de1cfc19e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37683 } }
I20260810 21:08:57.549710 17606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "512dd32ef96b4adea333ee6de1cfc19e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "512dd32ef96b4adea333ee6de1cfc19e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37683 } } }
I20260810 21:08:57.549865 17606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:57.550056 17606 sys_catalog.cc:455] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 512dd32ef96b4adea333ee6de1cfc19e. Latest consensus state: current_term: 1 leader_uuid: "512dd32ef96b4adea333ee6de1cfc19e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "512dd32ef96b4adea333ee6de1cfc19e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37683 } } }
I20260810 21:08:57.550168 17606 sys_catalog.cc:458] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:57.550446 17620 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:57.551079 17620 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 21:08:57 dist-test-slave-jq4t krb5kdc[17473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396137, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 21:08:57.555207 17620 catalog_manager.cc:1347] Generated new cluster ID: 5fae0c538b4c4b6bbb7f528d8e908ffe
I20260810 21:08:57.555361 17620 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:08:57.559125 17604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:57.546206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:47831 (local address 127.0.0.1:37683)
0810 21:08:57.546462 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:57.546472 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:57.546518 (+ 46us) server_negotiation.cc:407] Connection header received
0810 21:08:57.546636 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:57.546643 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:57.546694 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:57.546850 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:57.548078 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:57.549498 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:57.550680 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:57.551328 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:57.551447 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:57.554744 (+ 3297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:57.554750 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:57.554751 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:57.554767 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:57.556889 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:57.557366 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:57.557371 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:57.557371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:57.557521 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:57.557749 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:57.557750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:57.557751 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:57.558095 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:57.558248 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:57.558759 (+ 511us) server_negotiation.cc:299] Negotiation successful
0810 21:08:57.558883 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":114,"threads_started":1}
I20260810 21:08:57.560200 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:08:57.576519 17604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:57.561733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:54649 (local address 127.0.0.1:37683)
0810 21:08:57.561772 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:57.561774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:57.567899 (+ 6125us) server_negotiation.cc:407] Connection header received
0810 21:08:57.568012 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:57.568013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:57.568026 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:57.568056 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:57.568848 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:57.569608 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:57.570624 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:57.570980 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:57.571019 (+ 39us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:57.573548 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:57.573550 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:57.573550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:08:57.573559 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:57.575185 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:57.575637 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:57.575639 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:57.575639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:57.575691 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:08:57.575886 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:08:57.575887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:08:57.575887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:08:57.576011 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:57.576098 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:57.576296 (+ 198us) server_negotiation.cc:299] Negotiation successful
0810 21:08:57.576373 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 21:08:57.579151 17620 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:57.579870 17620 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:57.600692 17620 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 512dd32ef96b4adea333ee6de1cfc19e: Generated new TSK 0
I20260810 21:08:57.601094 17620 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:57.608114 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 17490
W20260810 21:08:57.629478 17470 connection.cc:535] client connection to 127.0.0.1:37683 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37683): Connection reset by peer (error 104)
2026-08-10T21:08:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1633 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:57 dist-test-slave-jq4t krb5kdc[17645](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:57 dist-test-slave-jq4t krb5kdc[17645](info): set up 2 sockets
Aug 10 21:08:57 dist-test-slave-jq4t krb5kdc[17645](info): commencing operation
krb5kdc: starting...
W20260810 21:08:58.930320 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:08:59 dist-test-slave-jq4t krb5kdc[17645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:08:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:08:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 21:08:59.067983 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36901
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:08:59.155575 17661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:08:59.155874 17661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:08:59.155932 17661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:08:59.157238 17661 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:08:59.157330 17661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:08:59.157356 17661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:08:59.157375 17661 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:08:59.157403 17661 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:08:59.159055 17661 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36901
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:08:59.159382 17661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:08:59.159657 17661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:08:59.165020 17674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:59.165010 17668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:08:59.165010 17667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:08:59.165181 17661 server_base.cc:1034] running on GCE node
I20260810 21:08:59.165513 17661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:08:59.165886 17661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:08:59.167066 17661 hybrid_clock.cc:648] HybridClock initialized: now 1786396139167052 us; error 49 us; skew 500 ppm
Aug 10 21:08:59 dist-test-slave-jq4t krb5kdc[17645](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396139, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:08:59.169854 17661 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 21:08:59.170374 17661 webserver.cc:460] Webserver started at http://127.0.0.1:36919/ using document root <none> and password file <none>
I20260810 21:08:59.170612 17661 fs_manager.cc:359] Metadata directory not provided
I20260810 21:08:59.170657 17661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:08:59.170758 17661 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:08:59.171865 17661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "f1e689ae9d69429c91c2217332daf24b"
format_stamp: "Formatted at 2026-08-10 21:08:59 on dist-test-slave-jq4t"
server_key: "b1acbcd7f2dfedc0a8b9d803ad48f372"
server_key_iv: "c232fcf6fc474708a603ead09c92eb56"
server_key_version: "encryptionkey@0"
I20260810 21:08:59.172194 17661 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "f1e689ae9d69429c91c2217332daf24b"
format_stamp: "Formatted at 2026-08-10 21:08:59 on dist-test-slave-jq4t"
server_key: "b1acbcd7f2dfedc0a8b9d803ad48f372"
server_key_iv: "c232fcf6fc474708a603ead09c92eb56"
server_key_version: "encryptionkey@0"
I20260810 21:08:59.173689 17661 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:08:59.174558 17686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:08:59.174753 17661 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:08:59.174851 17661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "f1e689ae9d69429c91c2217332daf24b"
format_stamp: "Formatted at 2026-08-10 21:08:59 on dist-test-slave-jq4t"
server_key: "b1acbcd7f2dfedc0a8b9d803ad48f372"
server_key_iv: "c232fcf6fc474708a603ead09c92eb56"
server_key_version: "encryptionkey@0"
I20260810 21:08:59.174916 17661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:08:59.192318 17661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:08:59.194943 17661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:08:59.195079 17661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:08:59.199397 17661 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36901
I20260810 21:08:59.199498 17769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36901 every 8 connection(s)
I20260810 21:08:59.199896 17661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:08:59.200942 17770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:08:59.203588 17770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b: Bootstrap starting.
I20260810 21:08:59.204239 17770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b: Neither blocks nor log segments found. Creating new log.
I20260810 21:08:59.204645 17770 log.cc:824] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b: Log is configured to *not* fsync() on all Append() calls
I20260810 21:08:59.204654 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 17661
I20260810 21:08:59.204797 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:08:59.205030 15508 external_mini_cluster.cc:1428] Setting key 9b8696fdd8f5c7ea8293f2298762d958
I20260810 21:08:59.205510 17770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b: No bootstrap required, opened a new log
I20260810 21:08:59.207931 17770 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1e689ae9d69429c91c2217332daf24b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36901 } }
I20260810 21:08:59.208076 17770 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:08:59.208099 17770 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1e689ae9d69429c91c2217332daf24b, State: Initialized, Role: FOLLOWER
I20260810 21:08:59.208246 17770 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1e689ae9d69429c91c2217332daf24b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36901 } }
I20260810 21:08:59.208340 17770 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:08:59.208391 17770 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:08:59.208437 17770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:08:59.209080 17770 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1e689ae9d69429c91c2217332daf24b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36901 } }
I20260810 21:08:59.209208 17770 leader_election.cc:302] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1e689ae9d69429c91c2217332daf24b; no voters:
I20260810 21:08:59.209419 17770 leader_election.cc:288] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:08:59.209439 17775 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:08:59.209568 17775 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [term 1 LEADER]: Becoming Leader. State: Replica: f1e689ae9d69429c91c2217332daf24b, State: Running, Role: LEADER
I20260810 21:08:59.209656 17775 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1e689ae9d69429c91c2217332daf24b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36901 } }
I20260810 21:08:59.209702 17770 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:08:59.209980 17775 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1e689ae9d69429c91c2217332daf24b. Latest consensus state: current_term: 1 leader_uuid: "f1e689ae9d69429c91c2217332daf24b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1e689ae9d69429c91c2217332daf24b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36901 } } }
I20260810 21:08:59.210048 17775 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:59.210330 17776 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1e689ae9d69429c91c2217332daf24b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1e689ae9d69429c91c2217332daf24b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36901 } } }
I20260810 21:08:59.210467 17776 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b [sys.catalog]: This master's current role is: LEADER
I20260810 21:08:59.210785 17779 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:08:59.211405 17779 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:08:59.211705 17774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:59.205634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:38367 (local address 127.0.0.1:36901)
0810 21:08:59.205847 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:59.205857 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:59.205915 (+ 58us) server_negotiation.cc:407] Connection header received
0810 21:08:59.206775 (+ 860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:59.206783 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:59.206839 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:59.206993 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:59.207230 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:59.208226 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:59.209127 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:59.209836 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:59.209949 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:59.210852 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:59.210858 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:59.210858 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:59.211108 (+ 250us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:59.211151 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:59.211167 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:59.211292 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:59.211409 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 21:08:59.211443 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":96,"threads_started":1}
I20260810 21:08:59.212971 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:08:59.213109 17779 catalog_manager.cc:1347] Generated new cluster ID: 1ccef53699a746d0aea99d2f56fb9654
I20260810 21:08:59.213152 17779 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:08:59.228626 17774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:08:59.214505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:42631 (local address 127.0.0.1:36901)
0810 21:08:59.224571 (+ 10066us) server_negotiation.cc:206] Beginning negotiation
0810 21:08:59.224574 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:08:59.224590 (+ 16us) server_negotiation.cc:407] Connection header received
0810 21:08:59.224625 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:08:59.224627 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:08:59.224658 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:08:59.224766 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:08:59.225006 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:59.225862 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:59.226992 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:08:59.227357 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:08:59.227458 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:08:59.228294 (+ 836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:08:59.228296 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:08:59.228297 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:08:59.228303 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:08:59.228323 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:08:59.228329 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:08:59.228398 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 21:08:59.228507 (+ 109us) server_negotiation.cc:299] Negotiation successful
0810 21:08:59.228522 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":10017}
I20260810 21:08:59.238273 17779 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:08:59.238898 17779 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:08:59.242314 17779 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1e689ae9d69429c91c2217332daf24b: Generated new TSK 0
I20260810 21:08:59.242551 17779 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:08:59.245019 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 17661
W20260810 21:08:59.265125 17641 connection.cc:535] client connection to 127.0.0.1:36901 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36901): Connection reset by peer (error 104)
2026-08-10T21:08:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1635 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:08:59 dist-test-slave-jq4t krb5kdc[17813](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:08:59 dist-test-slave-jq4t krb5kdc[17813](info): set up 2 sockets
Aug 10 21:08:59 dist-test-slave-jq4t krb5kdc[17813](info): commencing operation
krb5kdc: starting...
W20260810 21:09:00.557471 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:09:00 dist-test-slave-jq4t krb5kdc[17813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396140, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:09:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:09:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 21:09:00.708019 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42809
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42809
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:09:00.800304 17832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:09:00.800607 17832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:09:00.800653 17832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:09:00.801875 17832 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:09:00.801962 17832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:09:00.801990 17832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:09:00.802019 17832 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:09:00.802050 17832 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:09:00.803623 17832 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42809
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:09:00.803915 17832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:09:00.804167 17832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:09:00.809314 17839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:00.809410 17832 server_base.cc:1034] running on GCE node
W20260810 21:09:00.809329 17844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:00.809317 17840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:00.809813 17832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:09:00.810139 17832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:09:00.811316 17832 hybrid_clock.cc:648] HybridClock initialized: now 1786396140811299 us; error 28 us; skew 500 ppm
Aug 10 21:09:00 dist-test-slave-jq4t krb5kdc[17813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396140, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:09:00.814070 17832 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 21:09:00.814566 17832 webserver.cc:460] Webserver started at http://127.0.0.1:46219/ using document root <none> and password file <none>
I20260810 21:09:00.814850 17832 fs_manager.cc:359] Metadata directory not provided
I20260810 21:09:00.814934 17832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:09:00.815093 17832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:09:00.816310 17832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "d626b59ffe024ffd908c1f4beec72734"
format_stamp: "Formatted at 2026-08-10 21:09:00 on dist-test-slave-jq4t"
server_key: "73128e6cf53175fb5a974c12be6e2531"
server_key_iv: "988608d0a19208ac1cc417f9ea951c69"
server_key_version: "encryptionkey@0"
I20260810 21:09:00.816732 17832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "d626b59ffe024ffd908c1f4beec72734"
format_stamp: "Formatted at 2026-08-10 21:09:00 on dist-test-slave-jq4t"
server_key: "73128e6cf53175fb5a974c12be6e2531"
server_key_iv: "988608d0a19208ac1cc417f9ea951c69"
server_key_version: "encryptionkey@0"
I20260810 21:09:00.818207 17832 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:09:00.819052 17853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:09:00.819316 17832 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:09:00.819455 17832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "d626b59ffe024ffd908c1f4beec72734"
format_stamp: "Formatted at 2026-08-10 21:09:00 on dist-test-slave-jq4t"
server_key: "73128e6cf53175fb5a974c12be6e2531"
server_key_iv: "988608d0a19208ac1cc417f9ea951c69"
server_key_version: "encryptionkey@0"
I20260810 21:09:00.819542 17832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:09:00.823208 17832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:09:00.826012 17832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:09:00.826189 17832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:09:00.830646 17832 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42809
I20260810 21:09:00.830683 17940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42809 every 8 connection(s)
I20260810 21:09:00.831101 17832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:09:00.832233 17941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:09:00.834942 17941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734: Bootstrap starting.
I20260810 21:09:00.835594 17941 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734: Neither blocks nor log segments found. Creating new log.
I20260810 21:09:00.835916 17941 log.cc:824] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734: Log is configured to *not* fsync() on all Append() calls
I20260810 21:09:00.835918 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 17832
I20260810 21:09:00.836066 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:09:00.836298 15508 external_mini_cluster.cc:1428] Setting key 5938a446df1b5fd170bd663894440f1b
I20260810 21:09:00.836853 17941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734: No bootstrap required, opened a new log
I20260810 21:09:00.838678 17941 raft_consensus.cc:348] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d626b59ffe024ffd908c1f4beec72734" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42809 } }
I20260810 21:09:00.838861 17941 raft_consensus.cc:374] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:09:00.838902 17941 raft_consensus.cc:729] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d626b59ffe024ffd908c1f4beec72734, State: Initialized, Role: FOLLOWER
I20260810 21:09:00.839058 17941 consensus_queue.cc:260] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d626b59ffe024ffd908c1f4beec72734" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42809 } }
I20260810 21:09:00.839159 17941 raft_consensus.cc:388] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:09:00.839207 17941 raft_consensus.cc:482] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:09:00.839267 17941 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:09:00.840258 17950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:00.836926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:45621 (local address 127.0.0.1:42809)
0810 21:09:00.837166 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:00.837174 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:00.837198 (+ 24us) server_negotiation.cc:407] Connection header received
0810 21:09:00.838665 (+ 1467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:00.838676 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:00.838712 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:00.838888 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:00.839726 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:00.839730 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:00.839730 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:09:00.839735 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:00.839776 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:09:00.839788 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:00.839846 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:00.839972 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 21:09:00.840046 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":78,"threads_started":1}
I20260810 21:09:00.840667 17941 raft_consensus.cc:504] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d626b59ffe024ffd908c1f4beec72734" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42809 } }
I20260810 21:09:00.840803 17941 leader_election.cc:302] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d626b59ffe024ffd908c1f4beec72734; no voters:
I20260810 21:09:00.841017 17941 leader_election.cc:288] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:09:00.841056 17951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:09:00.841240 17951 raft_consensus.cc:686] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [term 1 LEADER]: Becoming Leader. State: Replica: d626b59ffe024ffd908c1f4beec72734, State: Running, Role: LEADER
I20260810 21:09:00.841298 17941 sys_catalog.cc:564] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:09:00.841354 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:09:00.841344 17951 consensus_queue.cc:237] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d626b59ffe024ffd908c1f4beec72734" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42809 } }
I20260810 21:09:00.841712 17951 sys_catalog.cc:455] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d626b59ffe024ffd908c1f4beec72734. Latest consensus state: current_term: 1 leader_uuid: "d626b59ffe024ffd908c1f4beec72734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d626b59ffe024ffd908c1f4beec72734" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42809 } } }
I20260810 21:09:00.841790 17951 sys_catalog.cc:458] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:00.841722 17958 sys_catalog.cc:455] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d626b59ffe024ffd908c1f4beec72734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d626b59ffe024ffd908c1f4beec72734" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42809 } } }
I20260810 21:09:00.841981 17958 sys_catalog.cc:458] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734 [sys.catalog]: This master's current role is: LEADER
W20260810 21:09:00.843143 17986 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:09:00.843207 17986 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:09:00.844198 17968 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:09:00.844410 17968 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:09:00.844511 17950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:00.842990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.48:60859 (local address 127.0.0.1:42809)
0810 21:09:00.843034 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:00.843036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:00.843154 (+ 118us) server_negotiation.cc:407] Connection header received
0810 21:09:00.843293 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:00.843293 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:00.843300 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:00.843364 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:00.844111 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:00.844112 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:00.844113 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:09:00.844116 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:00.844151 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:09:00.844157 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:00.844225 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:00.844354 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 21:09:00.844369 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 21:09:00.846284 17968 catalog_manager.cc:1347] Generated new cluster ID: 86e18661f614442e9012a41b39f95562
I20260810 21:09:00.846345 17968 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:09:00.850880 17968 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:09:00.851099 17968 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:09:00.855181 17968 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d626b59ffe024ffd908c1f4beec72734: Generated new TSK 0
I20260810 21:09:00.855398 17968 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:09:00.861564 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 17832
2026-08-10T21:09:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1607 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:09:00 dist-test-slave-jq4t krb5kdc[17999](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:09:00 dist-test-slave-jq4t krb5kdc[17999](info): set up 2 sockets
Aug 10 21:09:00 dist-test-slave-jq4t krb5kdc[17999](info): commencing operation
krb5kdc: starting...
W20260810 21:09:02.139709 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:09:02 dist-test-slave-jq4t krb5kdc[17999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:09:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:09:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:09:02.275385 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39701
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:44473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:39701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:09:02.364662 18022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:09:02.364902 18022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:09:02.364926 18022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:09:02.366183 18022 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:09:02.366236 18022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:09:02.366251 18022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:09:02.366264 18022 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:09:02.366276 18022 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:09:02.367908 18022 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:44473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:39701
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:09:02.368219 18022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:09:02.368510 18022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:09:02.373941 18033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:02.373955 18028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:02.373930 18031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:02.374186 18022 server_base.cc:1034] running on GCE node
I20260810 21:09:02.374476 18022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:09:02.374846 18022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:09:02.376020 18022 hybrid_clock.cc:648] HybridClock initialized: now 1786396142376002 us; error 41 us; skew 500 ppm
Aug 10 21:09:02 dist-test-slave-jq4t krb5kdc[17999](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396142, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:09:02.382644 18022 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:09:02.383222 18022 webserver.cc:460] Webserver started at http://127.15.37.62:43829/ using document root <none> and password file <none>
I20260810 21:09:02.383486 18022 fs_manager.cc:359] Metadata directory not provided
I20260810 21:09:02.383560 18022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:09:02.383723 18022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:09:02.384951 18022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "92114948673c45cfb96f52ae08e0ab6e"
format_stamp: "Formatted at 2026-08-10 21:09:02 on dist-test-slave-jq4t"
server_key: "82a98841c523b69c1794747ec0d336bf"
server_key_iv: "33d0a85441503d77db86cb20d4ecfb11"
server_key_version: "encryptionkey@0"
I20260810 21:09:02.385336 18022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "92114948673c45cfb96f52ae08e0ab6e"
format_stamp: "Formatted at 2026-08-10 21:09:02 on dist-test-slave-jq4t"
server_key: "82a98841c523b69c1794747ec0d336bf"
server_key_iv: "33d0a85441503d77db86cb20d4ecfb11"
server_key_version: "encryptionkey@0"
I20260810 21:09:02.386850 18022 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:09:02.387739 18047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:09:02.387985 18022 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:09:02.388105 18022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "92114948673c45cfb96f52ae08e0ab6e"
format_stamp: "Formatted at 2026-08-10 21:09:02 on dist-test-slave-jq4t"
server_key: "82a98841c523b69c1794747ec0d336bf"
server_key_iv: "33d0a85441503d77db86cb20d4ecfb11"
server_key_version: "encryptionkey@0"
I20260810 21:09:02.388190 18022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:09:02.416945 18022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:09:02.419617 18022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:09:02.419808 18022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:09:02.424559 18022 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:39701
I20260810 21:09:02.424638 18129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:39701 every 8 connection(s)
I20260810 21:09:02.425034 18022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:09:02.426003 18130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:09:02.428561 18130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e: Bootstrap starting.
I20260810 21:09:02.429232 18130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e: Neither blocks nor log segments found. Creating new log.
I20260810 21:09:02.429561 18130 log.cc:824] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e: Log is configured to *not* fsync() on all Append() calls
I20260810 21:09:02.430480 18130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e: No bootstrap required, opened a new log
I20260810 21:09:02.432422 18130 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92114948673c45cfb96f52ae08e0ab6e" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39701 } }
I20260810 21:09:02.432749 18130 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:09:02.432803 18130 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92114948673c45cfb96f52ae08e0ab6e, State: Initialized, Role: FOLLOWER
I20260810 21:09:02.432919 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 18022
I20260810 21:09:02.433053 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:09:02.432996 18130 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92114948673c45cfb96f52ae08e0ab6e" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39701 } }
I20260810 21:09:02.433095 18130 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:09:02.433133 18130 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:09:02.433192 18130 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:09:02.433300 15508 external_mini_cluster.cc:1428] Setting key a883a26bef099cb63dbe5e54eaf91c95
I20260810 21:09:02.434432 18130 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92114948673c45cfb96f52ae08e0ab6e" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39701 } }
I20260810 21:09:02.434571 18130 leader_election.cc:302] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92114948673c45cfb96f52ae08e0ab6e; no voters:
I20260810 21:09:02.434753 18130 leader_election.cc:288] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:09:02.434798 18137 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:09:02.434990 18137 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [term 1 LEADER]: Becoming Leader. State: Replica: 92114948673c45cfb96f52ae08e0ab6e, State: Running, Role: LEADER
I20260810 21:09:02.435060 18130 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:09:02.435113 18137 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92114948673c45cfb96f52ae08e0ab6e" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39701 } }
I20260810 21:09:02.435499 18137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92114948673c45cfb96f52ae08e0ab6e. Latest consensus state: current_term: 1 leader_uuid: "92114948673c45cfb96f52ae08e0ab6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92114948673c45cfb96f52ae08e0ab6e" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39701 } } }
I20260810 21:09:02.435570 18137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:02.435825 18144 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:09:02.436576 18140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92114948673c45cfb96f52ae08e0ab6e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92114948673c45cfb96f52ae08e0ab6e" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39701 } } }
I20260810 21:09:02.436661 18140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:02.436555 18144 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:09:02.439590 18144 catalog_manager.cc:1347] Generated new cluster ID: 5c52e537aa2e4efb82d747188367b1a9
I20260810 21:09:02.439666 18144 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:09:02 dist-test-slave-jq4t krb5kdc[17999](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396142, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:09:02.446480 18136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:02.433890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57061 (local address 127.15.37.62:39701)
0810 21:09:02.434147 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:02.434158 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:02.434197 (+ 39us) server_negotiation.cc:407] Connection header received
0810 21:09:02.434310 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:02.434315 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:02.434365 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:02.434515 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:02.435385 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:02.436961 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:02.438095 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:02.438553 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:02.438701 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:02.441859 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:02.441864 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:02.441865 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:02.441878 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:02.444010 (+ 2132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:02.444560 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:02.444563 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:02.444564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:02.444695 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:02.444976 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:02.444977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:02.444978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:02.445402 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:02.445566 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:02.446104 (+ 538us) server_negotiation.cc:299] Negotiation successful
0810 21:09:02.446226 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":131,"threads_started":1}
I20260810 21:09:02.447659 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:09:02.460906 18136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:02.449353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55737 (local address 127.15.37.62:39701)
0810 21:09:02.449392 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:02.449394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:02.452749 (+ 3355us) server_negotiation.cc:407] Connection header received
0810 21:09:02.452886 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:02.452888 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:02.452901 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:02.452971 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:02.453760 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:02.454534 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:02.455656 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:02.456040 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:02.456106 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:02.457819 (+ 1713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:02.457821 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:02.457821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:02.457837 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:02.459515 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:02.459973 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:02.459974 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:02.459974 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:02.460036 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:02.460281 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:02.460282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:02.460282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:02.460418 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:02.460539 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:02.460727 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 21:09:02.460793 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 21:09:02.470619 18144 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:09:02.471484 18144 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:09:02.477233 18144 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92114948673c45cfb96f52ae08e0ab6e: Generated new TSK 0
I20260810 21:09:02.477546 18144 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:09:02.485526 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 18022
W20260810 21:09:02.499588 17995 connection.cc:535] client connection to 127.15.37.62:39701 recv error: Network error: failed to read from TLS socket (remote: 127.15.37.62:39701): Connection reset by peer (error 104)
2026-08-10T21:09:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1627 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:09:02 dist-test-slave-jq4t krb5kdc[18173](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:09:02 dist-test-slave-jq4t krb5kdc[18173](info): set up 2 sockets
Aug 10 21:09:02 dist-test-slave-jq4t krb5kdc[18173](info): commencing operation
krb5kdc: starting...
W20260810 21:09:03.769639 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:09:03 dist-test-slave-jq4t krb5kdc[18173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396143, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:09:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:09:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:09:03.903894 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39627
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:34569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:39627
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:09:03.996583 18196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:09:03.996902 18196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:09:03.996948 18196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:09:03.998306 18196 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:09:03.998405 18196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:09:03.998438 18196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:09:03.998461 18196 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:09:03.998489 18196 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:09:04.000316 18196 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:34569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:39627
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:39627
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:09:04.000723 18196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:09:04.001003 18196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:09:04.006637 18205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:04.006647 18206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:04.006850 18196 server_base.cc:1034] running on GCE node
W20260810 21:09:04.006655 18210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:04.007231 18196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:09:04.007731 18196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:09:04.009027 18196 hybrid_clock.cc:648] HybridClock initialized: now 1786396144009070 us; error 103 us; skew 500 ppm
Aug 10 21:09:04 dist-test-slave-jq4t krb5kdc[18173](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396144, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:09:04.012701 18196 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:09:04.013260 18196 webserver.cc:460] Webserver started at http://127.15.37.62:45815/ using document root <none> and password file <none>
I20260810 21:09:04.013579 18196 fs_manager.cc:359] Metadata directory not provided
I20260810 21:09:04.013660 18196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:09:04.013844 18196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:09:04.015290 18196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "dfea43fc32984ef598aa53940b143c89"
format_stamp: "Formatted at 2026-08-10 21:09:04 on dist-test-slave-jq4t"
server_key: "22399a99be2bbc5e81024fc92f47bda7"
server_key_iv: "a4eebc75c7db1b16542846d58363dadc"
server_key_version: "encryptionkey@0"
I20260810 21:09:04.015704 18196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "dfea43fc32984ef598aa53940b143c89"
format_stamp: "Formatted at 2026-08-10 21:09:04 on dist-test-slave-jq4t"
server_key: "22399a99be2bbc5e81024fc92f47bda7"
server_key_iv: "a4eebc75c7db1b16542846d58363dadc"
server_key_version: "encryptionkey@0"
I20260810 21:09:04.017309 18196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260810 21:09:04.018151 18225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:09:04.018355 18196 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:09:04.018473 18196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "dfea43fc32984ef598aa53940b143c89"
format_stamp: "Formatted at 2026-08-10 21:09:04 on dist-test-slave-jq4t"
server_key: "22399a99be2bbc5e81024fc92f47bda7"
server_key_iv: "a4eebc75c7db1b16542846d58363dadc"
server_key_version: "encryptionkey@0"
I20260810 21:09:04.018558 18196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:09:04.040197 18196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:09:04.042724 18196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:09:04.042944 18196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:09:04.048166 18196 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:39627
I20260810 21:09:04.048203 18312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:39627 every 8 connection(s)
I20260810 21:09:04.048707 18196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:09:04.049809 18314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:09:04.051443 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 18196
I20260810 21:09:04.051580 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:09:04.051827 15508 external_mini_cluster.cc:1428] Setting key 0813b0b394019674ab2865e3056d978d
I20260810 21:09:04.053149 18314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89: Bootstrap starting.
I20260810 21:09:04.054018 18314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89: Neither blocks nor log segments found. Creating new log.
I20260810 21:09:04.054394 18314 log.cc:824] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89: Log is configured to *not* fsync() on all Append() calls
I20260810 21:09:04.055285 18314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89: No bootstrap required, opened a new log
I20260810 21:09:04.057803 18314 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfea43fc32984ef598aa53940b143c89" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39627 } }
I20260810 21:09:04.057981 18314 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:09:04.058004 18314 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfea43fc32984ef598aa53940b143c89, State: Initialized, Role: FOLLOWER
I20260810 21:09:04.058233 18314 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfea43fc32984ef598aa53940b143c89" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39627 } }
I20260810 21:09:04.058346 18314 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:09:04.058390 18314 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:09:04.058445 18314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:09:04.058950 18317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:04.052614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42887 (local address 127.15.37.62:39627)
0810 21:09:04.052835 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:04.052847 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:04.052904 (+ 57us) server_negotiation.cc:407] Connection header received
0810 21:09:04.053526 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:04.053538 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:04.053620 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:04.053801 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:04.054043 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:04.055492 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:04.056388 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:04.057099 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:04.057256 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:04.058168 (+ 912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:04.058173 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:04.058173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:09:04.058423 (+ 250us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:04.058472 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:09:04.058490 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:04.058588 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:04.058688 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 21:09:04.058722 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":92,"threads_started":1}
I20260810 21:09:04.059314 18314 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfea43fc32984ef598aa53940b143c89" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39627 } }
I20260810 21:09:04.059448 18314 leader_election.cc:302] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfea43fc32984ef598aa53940b143c89; no voters:
I20260810 21:09:04.059643 18314 leader_election.cc:288] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:09:04.060029 18314 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:09:04.060233 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:09:04.059661 18321 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:09:04.060730 18321 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [term 1 LEADER]: Becoming Leader. State: Replica: dfea43fc32984ef598aa53940b143c89, State: Running, Role: LEADER
I20260810 21:09:04.060911 18321 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfea43fc32984ef598aa53940b143c89" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39627 } }
W20260810 21:09:04.062100 18347 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260810 21:09:04.061400 18321 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfea43fc32984ef598aa53940b143c89. Latest consensus state: current_term: 1 leader_uuid: "dfea43fc32984ef598aa53940b143c89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfea43fc32984ef598aa53940b143c89" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39627 } } }
W20260810 21:09:04.062157 18347 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:09:04.061617 18322 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dfea43fc32984ef598aa53940b143c89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfea43fc32984ef598aa53940b143c89" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 39627 } } }
I20260810 21:09:04.062189 18321 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:04.062196 18322 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89 [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:04.062716 18356 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:09:04.062985 18356 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:09:04.064813 18356 catalog_manager.cc:1347] Generated new cluster ID: 8e1e2110fb9641e59fe7b12663d735e8
I20260810 21:09:04.064986 18356 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:09:04.066134 18317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:04.062092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49263 (local address 127.15.37.62:39627)
0810 21:09:04.062136 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:04.062139 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:04.062320 (+ 181us) server_negotiation.cc:407] Connection header received
0810 21:09:04.062355 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:04.062356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:04.062368 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:04.062418 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:04.062607 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:04.063364 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:04.064431 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:04.064761 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:04.064829 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:04.065828 (+ 999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:04.065829 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:04.065830 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:09:04.065835 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:04.065851 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:09:04.065856 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:04.065899 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:04.066044 (+ 145us) server_negotiation.cc:299] Negotiation successful
0810 21:09:04.066054 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 21:09:04.104264 18356 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:09:04.105093 18356 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:09:04.112640 18356 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dfea43fc32984ef598aa53940b143c89: Generated new TSK 0
I20260810 21:09:04.112950 18356 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:09:04.122262 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 18196
W20260810 21:09:04.140033 18171 connection.cc:535] client connection to 127.15.37.62:39627 recv error: Network error: failed to read from TLS socket (remote: 127.15.37.62:39627): Connection reset by peer (error 104)
2026-08-10T21:09:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1640 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:09:04 dist-test-slave-jq4t krb5kdc[18362](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:09:04 dist-test-slave-jq4t krb5kdc[18362](info): set up 2 sockets
Aug 10 21:09:04 dist-test-slave-jq4t krb5kdc[18362](info): commencing operation
krb5kdc: starting...
W20260810 21:09:05.420787 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.266s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:09:05 dist-test-slave-jq4t krb5kdc[18362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396145, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:09:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:09:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:09:05.556051 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:35557
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:40647
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:35557
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:09:05.643918 18382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:09:05.644167 18382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:09:05.644193 18382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:09:05.645368 18382 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:09:05.645408 18382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:09:05.645423 18382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:09:05.645437 18382 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:09:05.645449 18382 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:09:05.646948 18382 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:40647
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:35557
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:35557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:09:05.647174 18382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:09:05.647363 18382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:09:05.653057 18393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:05.653208 18382 server_base.cc:1034] running on GCE node
W20260810 21:09:05.653070 18389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:05.653079 18387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:05.653564 18382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:09:05.653903 18382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:09:05.655112 18382 hybrid_clock.cc:648] HybridClock initialized: now 1786396145655104 us; error 39 us; skew 500 ppm
Aug 10 21:09:05 dist-test-slave-jq4t krb5kdc[18362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396145, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:09:05.657832 18382 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:09:05.658370 18382 webserver.cc:460] Webserver started at http://127.15.37.62:44783/ using document root <none> and password file <none>
I20260810 21:09:05.658623 18382 fs_manager.cc:359] Metadata directory not provided
I20260810 21:09:05.658699 18382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:09:05.658859 18382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:09:05.659998 18382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "31c5f8f0127940b5afe04d59674cc2dd"
format_stamp: "Formatted at 2026-08-10 21:09:05 on dist-test-slave-jq4t"
server_key: "ecd44f434e287e942cb0f772a3a068ff"
server_key_iv: "2325f55c4ec596aa0b6e4fb4a5180a47"
server_key_version: "encryptionkey@0"
I20260810 21:09:05.660380 18382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "31c5f8f0127940b5afe04d59674cc2dd"
format_stamp: "Formatted at 2026-08-10 21:09:05 on dist-test-slave-jq4t"
server_key: "ecd44f434e287e942cb0f772a3a068ff"
server_key_iv: "2325f55c4ec596aa0b6e4fb4a5180a47"
server_key_version: "encryptionkey@0"
I20260810 21:09:05.661851 18382 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:09:05.662662 18406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:09:05.662845 18382 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 21:09:05.662961 18382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "31c5f8f0127940b5afe04d59674cc2dd"
format_stamp: "Formatted at 2026-08-10 21:09:05 on dist-test-slave-jq4t"
server_key: "ecd44f434e287e942cb0f772a3a068ff"
server_key_iv: "2325f55c4ec596aa0b6e4fb4a5180a47"
server_key_version: "encryptionkey@0"
I20260810 21:09:05.663043 18382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:09:05.666687 18382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:09:05.669024 18382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:09:05.669209 18382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:09:05.673671 18382 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:35557
I20260810 21:09:05.673723 18488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:35557 every 8 connection(s)
I20260810 21:09:05.674115 18382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:09:05.675189 18490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:09:05.677784 18490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd: Bootstrap starting.
I20260810 21:09:05.678444 18490 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd: Neither blocks nor log segments found. Creating new log.
I20260810 21:09:05.678758 18490 log.cc:824] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd: Log is configured to *not* fsync() on all Append() calls
I20260810 21:09:05.679526 18490 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd: No bootstrap required, opened a new log
I20260810 21:09:05.681309 18490 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31c5f8f0127940b5afe04d59674cc2dd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35557 } }
I20260810 21:09:05.681471 18490 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:09:05.681495 18490 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31c5f8f0127940b5afe04d59674cc2dd, State: Initialized, Role: FOLLOWER
I20260810 21:09:05.681684 18490 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31c5f8f0127940b5afe04d59674cc2dd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35557 } }
I20260810 21:09:05.681769 18490 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:09:05.681813 18490 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:09:05.681866 18490 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:09:05.682578 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 18382
I20260810 21:09:05.682734 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:09:05.682928 15508 external_mini_cluster.cc:1428] Setting key c6fe6569640254be069add58898a42d5
I20260810 21:09:05.682993 18490 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31c5f8f0127940b5afe04d59674cc2dd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35557 } }
I20260810 21:09:05.683151 18490 leader_election.cc:302] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31c5f8f0127940b5afe04d59674cc2dd; no voters:
I20260810 21:09:05.683357 18490 leader_election.cc:288] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:09:05.683382 18495 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:09:05.683593 18495 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [term 1 LEADER]: Becoming Leader. State: Replica: 31c5f8f0127940b5afe04d59674cc2dd, State: Running, Role: LEADER
I20260810 21:09:05.683749 18490 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:09:05.683728 18495 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31c5f8f0127940b5afe04d59674cc2dd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35557 } }
I20260810 21:09:05.684108 18495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31c5f8f0127940b5afe04d59674cc2dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31c5f8f0127940b5afe04d59674cc2dd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35557 } } }
I20260810 21:09:05.684180 18495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:05.684356 18495 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31c5f8f0127940b5afe04d59674cc2dd. Latest consensus state: current_term: 1 leader_uuid: "31c5f8f0127940b5afe04d59674cc2dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31c5f8f0127940b5afe04d59674cc2dd" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 35557 } } }
I20260810 21:09:05.684422 18495 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:05.684692 18503 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:09:05.685717 18500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:05.683534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55575 (local address 127.15.37.62:35557)
0810 21:09:05.683839 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:05.683850 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:05.683886 (+ 36us) server_negotiation.cc:407] Connection header received
0810 21:09:05.684018 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:05.684025 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:05.684050 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:05.684238 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:05.685145 (+ 907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:05.685149 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:05.685149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:09:05.685154 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:05.685207 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:09:05.685223 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:05.685286 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:05.685419 (+ 133us) server_negotiation.cc:299] Negotiation successful
0810 21:09:05.685473 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":90,"threads_started":1}
I20260810 21:09:05.685942 18503 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:09:05.686704 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:09:05.687557 18503 catalog_manager.cc:1347] Generated new cluster ID: be24daf274d04cce88a288108dec707a
I20260810 21:09:05.687615 18503 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:09:05.695602 18503 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:09:05.695781 18503 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:09:05.696341 18500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:05.692950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47051 (local address 127.15.37.62:35557)
0810 21:09:05.692996 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:05.692999 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:05.695152 (+ 2153us) server_negotiation.cc:407] Connection header received
0810 21:09:05.695214 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:05.695215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:05.695224 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:05.695289 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:05.696051 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:05.696052 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:05.696053 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:09:05.696058 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:05.696077 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:09:05.696082 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:05.696160 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:05.696221 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 21:09:05.696238 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 21:09:05.700465 18503 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31c5f8f0127940b5afe04d59674cc2dd: Generated new TSK 0
I20260810 21:09:05.700723 18503 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:09:05.708840 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 18382
2026-08-10T21:09:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1600 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:09:05 dist-test-slave-jq4t krb5kdc[18538](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:09:05 dist-test-slave-jq4t krb5kdc[18538](info): set up 2 sockets
Aug 10 21:09:05 dist-test-slave-jq4t krb5kdc[18538](info): commencing operation
krb5kdc: starting...
W20260810 21:09:06.999603 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.244s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:09:07 dist-test-slave-jq4t krb5kdc[18538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:09:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:09:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:09:07.140331 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:41727
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:41515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:41727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:09:07.229684 18562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:09:07.229941 18562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:09:07.229970 18562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:09:07.231293 18562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:09:07.231346 18562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:09:07.231360 18562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:09:07.231374 18562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:09:07.231386 18562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:09:07.233054 18562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:41515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:41727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:41727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:09:07.233347 18562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:09:07.233615 18562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:09:07.239122 18573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:07.239096 18568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:07.239177 18569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:07.239328 18562 server_base.cc:1034] running on GCE node
I20260810 21:09:07.239706 18562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:09:07.240024 18562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:09:07.241214 18562 hybrid_clock.cc:648] HybridClock initialized: now 1786396147241204 us; error 39 us; skew 500 ppm
Aug 10 21:09:07 dist-test-slave-jq4t krb5kdc[18538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396147, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:09:07.244002 18562 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:09:07.244585 18562 webserver.cc:460] Webserver started at http://127.15.37.62:40871/ using document root <none> and password file <none>
I20260810 21:09:07.244827 18562 fs_manager.cc:359] Metadata directory not provided
I20260810 21:09:07.244904 18562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:09:07.245056 18562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:09:07.246219 18562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "89b3a5c1351445e7afe0db87bdc06cfa"
format_stamp: "Formatted at 2026-08-10 21:09:07 on dist-test-slave-jq4t"
server_key: "ebfdaabc239ac265382c3396dbfea341"
server_key_iv: "2fdabbef5910a6a597e3f402285d1445"
server_key_version: "encryptionkey@0"
I20260810 21:09:07.246604 18562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "89b3a5c1351445e7afe0db87bdc06cfa"
format_stamp: "Formatted at 2026-08-10 21:09:07 on dist-test-slave-jq4t"
server_key: "ebfdaabc239ac265382c3396dbfea341"
server_key_iv: "2fdabbef5910a6a597e3f402285d1445"
server_key_version: "encryptionkey@0"
I20260810 21:09:07.248283 18562 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:09:07.249408 18583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:09:07.249672 18562 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:09:07.249797 18562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "89b3a5c1351445e7afe0db87bdc06cfa"
format_stamp: "Formatted at 2026-08-10 21:09:07 on dist-test-slave-jq4t"
server_key: "ebfdaabc239ac265382c3396dbfea341"
server_key_iv: "2fdabbef5910a6a597e3f402285d1445"
server_key_version: "encryptionkey@0"
I20260810 21:09:07.249917 18562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:09:07.260625 18562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:09:07.264031 18562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:09:07.264272 18562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:09:07.269178 18562 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:41727
I20260810 21:09:07.269218 18665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:41727 every 8 connection(s)
I20260810 21:09:07.269693 18562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:09:07.270725 18668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:09:07.273556 18668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa: Bootstrap starting.
I20260810 21:09:07.274742 18668 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa: Neither blocks nor log segments found. Creating new log.
I20260810 21:09:07.275396 18668 log.cc:824] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa: Log is configured to *not* fsync() on all Append() calls
I20260810 21:09:07.276726 18668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa: No bootstrap required, opened a new log
I20260810 21:09:07.276948 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 18562
I20260810 21:09:07.277092 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:09:07.277313 15508 external_mini_cluster.cc:1428] Setting key c1d7809609b0e84f120619bcf1d4896b
I20260810 21:09:07.279213 18668 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89b3a5c1351445e7afe0db87bdc06cfa" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41727 } }
I20260810 21:09:07.279465 18668 raft_consensus.cc:374] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:09:07.279508 18668 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89b3a5c1351445e7afe0db87bdc06cfa, State: Initialized, Role: FOLLOWER
I20260810 21:09:07.279721 18668 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89b3a5c1351445e7afe0db87bdc06cfa" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41727 } }
I20260810 21:09:07.279839 18668 raft_consensus.cc:388] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:09:07.279887 18668 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:09:07.279946 18668 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:09:07.281131 18668 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89b3a5c1351445e7afe0db87bdc06cfa" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41727 } }
I20260810 21:09:07.281275 18668 leader_election.cc:302] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89b3a5c1351445e7afe0db87bdc06cfa; no voters:
I20260810 21:09:07.281498 18668 leader_election.cc:288] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:09:07.281528 18676 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:09:07.281687 18676 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [term 1 LEADER]: Becoming Leader. State: Replica: 89b3a5c1351445e7afe0db87bdc06cfa, State: Running, Role: LEADER
I20260810 21:09:07.281841 18668 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:09:07.281850 18676 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89b3a5c1351445e7afe0db87bdc06cfa" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41727 } }
I20260810 21:09:07.282388 18680 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89b3a5c1351445e7afe0db87bdc06cfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89b3a5c1351445e7afe0db87bdc06cfa" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41727 } } }
I20260810 21:09:07.282405 18679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89b3a5c1351445e7afe0db87bdc06cfa. Latest consensus state: current_term: 1 leader_uuid: "89b3a5c1351445e7afe0db87bdc06cfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89b3a5c1351445e7afe0db87bdc06cfa" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 41727 } } }
I20260810 21:09:07.282637 18680 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:07.282747 18679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:07.282967 18690 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:09:07.283565 18690 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:09:07.286070 18690 catalog_manager.cc:1347] Generated new cluster ID: 3327b325eddc4dbf8d53d3ab9da9fd43
I20260810 21:09:07.286134 18690 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 21:09:07 dist-test-slave-jq4t krb5kdc[18538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:09:07.291517 18674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:07.278029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47253 (local address 127.15.37.62:41727)
0810 21:09:07.278260 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:07.278270 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:07.278300 (+ 30us) server_negotiation.cc:407] Connection header received
0810 21:09:07.279298 (+ 998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:07.279309 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:07.279382 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:07.279690 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:07.280543 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:07.281726 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:07.282840 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:07.283790 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:07.284415 (+ 625us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:07.287112 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:07.287117 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:07.287117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:07.287131 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:07.289113 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:07.289518 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:07.289523 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:07.289523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:07.289669 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:07.289932 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:07.289933 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:07.289934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:07.290216 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:07.290403 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:07.290859 (+ 456us) server_negotiation.cc:299] Negotiation successful
0810 21:09:07.291249 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":125,"threads_started":1}
I20260810 21:09:07.292744 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:09:07.302418 18674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:07.294471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52365 (local address 127.15.37.62:41727)
0810 21:09:07.294574 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:07.294576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:07.294635 (+ 59us) server_negotiation.cc:407] Connection header received
0810 21:09:07.294726 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:07.294727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:07.294740 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:07.294792 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:07.295452 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:07.296069 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:07.297012 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:07.297294 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:07.297399 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:07.298946 (+ 1547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:07.298948 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:07.298948 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:07.298959 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:07.300988 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:07.301423 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:07.301424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:07.301425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:07.301500 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:07.301737 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:07.301738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:07.301738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:07.301889 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:07.302021 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:07.302181 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 21:09:07.302276 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260810 21:09:07.321637 18690 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:09:07.322338 18690 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:09:07.329811 18690 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 89b3a5c1351445e7afe0db87bdc06cfa: Generated new TSK 0
I20260810 21:09:07.330061 18690 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:09:07.334679 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 18562
2026-08-10T21:09:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1611 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:09:07 dist-test-slave-jq4t krb5kdc[18721](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:09:07 dist-test-slave-jq4t krb5kdc[18721](info): set up 2 sockets
Aug 10 21:09:07 dist-test-slave-jq4t krb5kdc[18721](info): commencing operation
krb5kdc: starting...
W20260810 21:09:08.641373 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:09:08 dist-test-slave-jq4t krb5kdc[18721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396148, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:09:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:09:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:09:08.775612 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:43051
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:40149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:43051
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:09:08.862671 18738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:09:08.862973 18738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:09:08.863022 18738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:09:08.864300 18738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:09:08.864396 18738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:09:08.864419 18738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:09:08.864442 18738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:09:08.864511 18738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:09:08.866210 18738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:40149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:43051
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:43051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:09:08.866570 18738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:09:08.866832 18738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:09:08.872213 18749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:08.872213 18745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:08.872242 18747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:08.872519 18738 server_base.cc:1034] running on GCE node
I20260810 21:09:08.872835 18738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:09:08.873153 18738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:09:08.874341 18738 hybrid_clock.cc:648] HybridClock initialized: now 1786396148874332 us; error 53 us; skew 500 ppm
Aug 10 21:09:08 dist-test-slave-jq4t krb5kdc[18721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396148, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:09:08.877103 18738 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:09:08.877544 18738 webserver.cc:460] Webserver started at http://127.15.37.62:36571/ using document root <none> and password file <none>
I20260810 21:09:08.877820 18738 fs_manager.cc:359] Metadata directory not provided
I20260810 21:09:08.877869 18738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:09:08.878029 18738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:09:08.879175 18738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "3eff10dd596a417db5a68df870b00300"
format_stamp: "Formatted at 2026-08-10 21:09:08 on dist-test-slave-jq4t"
server_key: "78532d85c5538d229653a4bb6ba77324"
server_key_iv: "fb637d51f94ecaf8cdb58cad926700df"
server_key_version: "encryptionkey@0"
I20260810 21:09:08.879570 18738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "3eff10dd596a417db5a68df870b00300"
format_stamp: "Formatted at 2026-08-10 21:09:08 on dist-test-slave-jq4t"
server_key: "78532d85c5538d229653a4bb6ba77324"
server_key_iv: "fb637d51f94ecaf8cdb58cad926700df"
server_key_version: "encryptionkey@0"
I20260810 21:09:08.881129 18738 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:09:08.882020 18760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:09:08.882225 18738 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:09:08.882326 18738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "3eff10dd596a417db5a68df870b00300"
format_stamp: "Formatted at 2026-08-10 21:09:08 on dist-test-slave-jq4t"
server_key: "78532d85c5538d229653a4bb6ba77324"
server_key_iv: "fb637d51f94ecaf8cdb58cad926700df"
server_key_version: "encryptionkey@0"
I20260810 21:09:08.882423 18738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:09:08.891976 18738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:09:08.894483 18738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:09:08.894667 18738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:09:08.899150 18738 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:43051
I20260810 21:09:08.899211 18851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:43051 every 8 connection(s)
I20260810 21:09:08.899642 18738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:09:08.900787 18853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:09:08.902241 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 18738
I20260810 21:09:08.902348 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:09:08.902567 15508 external_mini_cluster.cc:1428] Setting key 527907afef79a708bc798e91418d590e
I20260810 21:09:08.903685 18853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300: Bootstrap starting.
I20260810 21:09:08.904333 18853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300: Neither blocks nor log segments found. Creating new log.
I20260810 21:09:08.904722 18853 log.cc:824] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300: Log is configured to *not* fsync() on all Append() calls
I20260810 21:09:08.905603 18853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300: No bootstrap required, opened a new log
I20260810 21:09:08.907584 18853 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eff10dd596a417db5a68df870b00300" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43051 } }
I20260810 21:09:08.907755 18853 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:09:08.907804 18853 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eff10dd596a417db5a68df870b00300, State: Initialized, Role: FOLLOWER
I20260810 21:09:08.907981 18853 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eff10dd596a417db5a68df870b00300" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43051 } }
I20260810 21:09:08.908085 18853 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:09:08.908134 18853 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:09:08.908185 18853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:09:08.908708 18858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:08.903216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44791 (local address 127.15.37.62:43051)
0810 21:09:08.903429 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:08.903437 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:08.903465 (+ 28us) server_negotiation.cc:407] Connection header received
0810 21:09:08.903950 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:08.903957 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:08.904011 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:08.904162 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:08.904404 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:08.905596 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:08.906589 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:08.907034 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:08.907162 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:08.907924 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:08.907929 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:08.907929 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:09:08.908180 (+ 251us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:08.908221 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:09:08.908237 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:08.908304 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:08.908373 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 21:09:08.908443 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":89,"threads_started":1}
I20260810 21:09:08.908924 18853 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eff10dd596a417db5a68df870b00300" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43051 } }
I20260810 21:09:08.909066 18853 leader_election.cc:302] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3eff10dd596a417db5a68df870b00300; no voters:
I20260810 21:09:08.909235 18853 leader_election.cc:288] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:09:08.909303 18860 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:09:08.909565 18860 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [term 1 LEADER]: Becoming Leader. State: Replica: 3eff10dd596a417db5a68df870b00300, State: Running, Role: LEADER
I20260810 21:09:08.909572 18853 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:09:08.909806 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:09:08.909698 18860 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eff10dd596a417db5a68df870b00300" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43051 } }
I20260810 21:09:08.911733 18862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3eff10dd596a417db5a68df870b00300. Latest consensus state: current_term: 1 leader_uuid: "3eff10dd596a417db5a68df870b00300" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eff10dd596a417db5a68df870b00300" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43051 } } }
I20260810 21:09:08.912657 18862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:08.911836 18861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3eff10dd596a417db5a68df870b00300" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eff10dd596a417db5a68df870b00300" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 43051 } } }
W20260810 21:09:08.912401 18891 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260810 21:09:08.912822 18861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300 [sys.catalog]: This master's current role is: LEADER
W20260810 21:09:08.912833 18891 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:09:08.912920 18896 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:09:08.913175 18896 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:09:08.915004 18896 catalog_manager.cc:1347] Generated new cluster ID: d6629b2defda47d68cc6783524a0d0a5
I20260810 21:09:08.915006 18858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:08.911395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43403 (local address 127.15.37.62:43051)
0810 21:09:08.911443 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:08.911445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:08.911508 (+ 63us) server_negotiation.cc:407] Connection header received
0810 21:09:08.911573 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:08.911574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:08.911585 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:08.911646 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:08.911850 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:08.912586 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:08.913664 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:08.913895 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:08.913981 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:08.914747 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:08.914749 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:08.914749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:09:08.914754 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:08.914770 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:09:08.914775 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:08.914837 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:08.914898 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 21:09:08.914924 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 21:09:08.915081 18896 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:09:08.935084 18896 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:09:08.935703 18896 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:09:08.945611 18896 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3eff10dd596a417db5a68df870b00300: Generated new TSK 0
I20260810 21:09:08.945869 18896 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:09:08.957338 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 18738
2026-08-10T21:09:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1627 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:09:09 dist-test-slave-jq4t krb5kdc[18904](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:09:09 dist-test-slave-jq4t krb5kdc[18904](info): set up 2 sockets
Aug 10 21:09:09 dist-test-slave-jq4t krb5kdc[18904](info): commencing operation
krb5kdc: starting...
W20260810 21:09:10.250479 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.256s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:09:10 dist-test-slave-jq4t krb5kdc[18904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396150, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:09:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:09:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:09:10.383914 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:46387
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:37261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:46387
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:09:10.473869 18923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:09:10.474126 18923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:09:10.474152 18923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:09:10.475301 18923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:09:10.475337 18923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:09:10.475353 18923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:09:10.475365 18923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:09:10.475378 18923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:09:10.477026 18923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:37261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:46387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:46387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:09:10.477273 18923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:09:10.477465 18923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:09:10.482594 18933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:10.482583 18930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:10.482583 18931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:10.482878 18923 server_base.cc:1034] running on GCE node
I20260810 21:09:10.483232 18923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:09:10.483589 18923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:09:10.484786 18923 hybrid_clock.cc:648] HybridClock initialized: now 1786396150484771 us; error 35 us; skew 500 ppm
Aug 10 21:09:10 dist-test-slave-jq4t krb5kdc[18904](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396150, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:09:10.491721 18923 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:09:10.492204 18923 webserver.cc:460] Webserver started at http://127.15.37.62:38635/ using document root <none> and password file <none>
I20260810 21:09:10.492421 18923 fs_manager.cc:359] Metadata directory not provided
I20260810 21:09:10.492470 18923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:09:10.492659 18923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:09:10.493775 18923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "ba264dbfb4bf4018b68f74ca86e9e8fe"
format_stamp: "Formatted at 2026-08-10 21:09:10 on dist-test-slave-jq4t"
server_key: "19d90beab860f4866309b1b609132081"
server_key_iv: "0a59031158d2f2e46ce4728a09602355"
server_key_version: "encryptionkey@0"
I20260810 21:09:10.494130 18923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "ba264dbfb4bf4018b68f74ca86e9e8fe"
format_stamp: "Formatted at 2026-08-10 21:09:10 on dist-test-slave-jq4t"
server_key: "19d90beab860f4866309b1b609132081"
server_key_iv: "0a59031158d2f2e46ce4728a09602355"
server_key_version: "encryptionkey@0"
I20260810 21:09:10.495597 18923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:09:10.496439 18946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:09:10.496717 18923 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:09:10.496834 18923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "ba264dbfb4bf4018b68f74ca86e9e8fe"
format_stamp: "Formatted at 2026-08-10 21:09:10 on dist-test-slave-jq4t"
server_key: "19d90beab860f4866309b1b609132081"
server_key_iv: "0a59031158d2f2e46ce4728a09602355"
server_key_version: "encryptionkey@0"
I20260810 21:09:10.496942 18923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:09:10.500560 18923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:09:10.502701 18923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:09:10.502888 18923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:09:10.507498 18923 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:46387
I20260810 21:09:10.507534 19028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:46387 every 8 connection(s)
I20260810 21:09:10.507927 18923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:09:10.509150 19032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:09:10.510946 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 18923
I20260810 21:09:10.511125 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:09:10.511363 15508 external_mini_cluster.cc:1428] Setting key 33f321c0924adeac49239b9c23390aab
I20260810 21:09:10.512121 19032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe: Bootstrap starting.
I20260810 21:09:10.512904 19032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe: Neither blocks nor log segments found. Creating new log.
I20260810 21:09:10.513298 19032 log.cc:824] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe: Log is configured to *not* fsync() on all Append() calls
I20260810 21:09:10.514209 19032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe: No bootstrap required, opened a new log
I20260810 21:09:10.514328 19035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:10.511967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60013 (local address 127.15.37.62:46387)
0810 21:09:10.512164 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:10.512172 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:10.512226 (+ 54us) server_negotiation.cc:407] Connection header received
0810 21:09:10.512762 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:10.512770 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:10.512798 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:10.512924 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:10.513777 (+ 853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:10.513781 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:10.513781 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:09:10.513786 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:10.513838 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:09:10.513853 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:10.513942 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:10.514024 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 21:09:10.514081 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
I20260810 21:09:10.515463 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:09:10.517112 19032 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba264dbfb4bf4018b68f74ca86e9e8fe" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46387 } }
I20260810 21:09:10.517385 19032 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 21:09:10.517462 19032 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba264dbfb4bf4018b68f74ca86e9e8fe, State: Initialized, Role: FOLLOWER
I20260810 21:09:10.517613 19032 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba264dbfb4bf4018b68f74ca86e9e8fe" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46387 } }
I20260810 21:09:10.517750 19032 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 21:09:10.517804 19032 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 21:09:10.517863 19032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:09:10.518420 19035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:10.517294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36063 (local address 127.15.37.62:46387)
0810 21:09:10.517340 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:10.517342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:10.517430 (+ 88us) server_negotiation.cc:407] Connection header received
0810 21:09:10.517513 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:10.517514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:10.517528 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:10.517587 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:10.518199 (+ 612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:10.518200 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:10.518200 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 21:09:10.518203 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:10.518217 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 21:09:10.518221 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:10.518265 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:10.518319 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 21:09:10.518329 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 21:09:10.518745 19032 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba264dbfb4bf4018b68f74ca86e9e8fe" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46387 } }
I20260810 21:09:10.518867 19032 leader_election.cc:302] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba264dbfb4bf4018b68f74ca86e9e8fe; no voters:
I20260810 21:09:10.519048 19032 leader_election.cc:288] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 21:09:10.519105 19048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:09:10.519268 19048 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [term 1 LEADER]: Becoming Leader. State: Replica: ba264dbfb4bf4018b68f74ca86e9e8fe, State: Running, Role: LEADER
I20260810 21:09:10.519362 19032 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:09:10.519402 19048 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba264dbfb4bf4018b68f74ca86e9e8fe" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46387 } }
I20260810 21:09:10.519825 19051 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba264dbfb4bf4018b68f74ca86e9e8fe. Latest consensus state: current_term: 1 leader_uuid: "ba264dbfb4bf4018b68f74ca86e9e8fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba264dbfb4bf4018b68f74ca86e9e8fe" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46387 } } }
I20260810 21:09:10.519814 19049 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba264dbfb4bf4018b68f74ca86e9e8fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba264dbfb4bf4018b68f74ca86e9e8fe" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 46387 } } }
I20260810 21:09:10.519935 19051 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:10.519942 19049 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:10.520524 19057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:09:10.521091 19057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:09:10.522907 19057 catalog_manager.cc:1347] Generated new cluster ID: 50774a2c22f340a39723f56522ac2786
I20260810 21:09:10.522961 19057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:09:10.539417 19057 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:09:10.539661 19057 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:09:10.544647 19057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba264dbfb4bf4018b68f74ca86e9e8fe: Generated new TSK 0
I20260810 21:09:10.544903 19057 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:09:10.550302 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 18923
2026-08-10T21:09:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1578 ms)
[----------] 18 tests from AuthTokenIssuingTest (29063 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:09:10 dist-test-slave-jq4t krb5kdc[19078](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:09:10 dist-test-slave-jq4t krb5kdc[19078](info): set up 2 sockets
Aug 10 21:09:10 dist-test-slave-jq4t krb5kdc[19078](info): commencing operation
krb5kdc: starting...
W20260810 21:09:11.849824 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:09:11 dist-test-slave-jq4t krb5kdc[19078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:09:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:09:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:09:11.984156 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:44001
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:44001,127.15.37.61:34393,127.15.37.60:34869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:09:12.074013 19098 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 21:09:12.074290 19098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:09:12.074309 19098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:09:12.074334 19098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:09:12.075800 19098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:09:12.075877 19098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:09:12.075899 19098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:09:12.075912 19098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:09:12.075925 19098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:09:12.077823 19098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:44001,127.15.37.61:34393,127.15.37.60:34869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:44001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:09:12.078109 19098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:09:12.078315 19098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:09:12.083709 19105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:12.083683 19109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:12.083685 19107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:12.083899 19098 server_base.cc:1034] running on GCE node
I20260810 21:09:12.084249 19098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:09:12.084672 19098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:09:12.085851 19098 hybrid_clock.cc:648] HybridClock initialized: now 1786396152085843 us; error 39 us; skew 500 ppm
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:09:12.088655 19098 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:09:12.089179 19098 webserver.cc:460] Webserver started at http://127.15.37.62:37019/ using document root <none> and password file <none>
I20260810 21:09:12.089438 19098 fs_manager.cc:359] Metadata directory not provided
I20260810 21:09:12.089514 19098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:09:12.089696 19098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:09:12.091022 19098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "39dafdc149514634aea29855c4c9b057"
format_stamp: "Formatted at 2026-08-10 21:09:12 on dist-test-slave-jq4t"
server_key: "76518b4b606f71170ffe16488db32a32"
server_key_iv: "3bf81998671583ea0a4a1ab6d97f68a0"
server_key_version: "encryptionkey@0"
I20260810 21:09:12.091444 19098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "39dafdc149514634aea29855c4c9b057"
format_stamp: "Formatted at 2026-08-10 21:09:12 on dist-test-slave-jq4t"
server_key: "76518b4b606f71170ffe16488db32a32"
server_key_iv: "3bf81998671583ea0a4a1ab6d97f68a0"
server_key_version: "encryptionkey@0"
I20260810 21:09:12.093181 19098 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260810 21:09:12.094022 19124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:09:12.094206 19098 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:09:12.094324 19098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "39dafdc149514634aea29855c4c9b057"
format_stamp: "Formatted at 2026-08-10 21:09:12 on dist-test-slave-jq4t"
server_key: "76518b4b606f71170ffe16488db32a32"
server_key_iv: "3bf81998671583ea0a4a1ab6d97f68a0"
server_key_version: "encryptionkey@0"
I20260810 21:09:12.094408 19098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:09:12.106698 19098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:09:12.109220 19098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:09:12.109421 19098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:09:12.114054 19098 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:44001
I20260810 21:09:12.114144 19196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:44001 every 8 connection(s)
I20260810 21:09:12.114544 19098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:09:12.115809 19197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:09:12.117674 19197 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:09:12.120858 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 19098
I20260810 21:09:12.120997 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:09:12.121191 15508 external_mini_cluster.cc:1428] Setting key 5c7ba1614a455b3d25d43c62a7990018
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:09:12.130589 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.118545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44001 (local address 127.0.0.1:55568)
0810 21:09:12.118792 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.118829 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:12.119337 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:12.119648 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:12.119651 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:12.119939 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:12.120131 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.120137 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.121691 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.121693 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.122440 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.122442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.123378 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.123379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.123469 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.124127 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:12.124139 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:12.125886 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:12.128753 (+ 2867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.128761 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.128764 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.129010 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.129336 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.129337 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.129337 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.129451 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.130010 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:12.130018 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:12.130108 (+ 90us) client_negotiation.cc:769] Sending connection context
0810 21:09:12.130204 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 21:09:12.130385 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"spinlock_wait_cycles":8576,"thread_start_us":139,"threads_started":1}
I20260810 21:09:12.130663 19205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.118573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55568 (local address 127.15.37.62:44001)
0810 21:09:12.118822 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.118834 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.118910 (+ 76us) server_negotiation.cc:407] Connection header received
0810 21:09:12.119505 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.119508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.119527 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.119612 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.120258 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.121557 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.122555 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.123230 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.123336 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.126003 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.126015 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.126016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.126025 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.128615 (+ 2590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.129114 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.129118 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.129118 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.129251 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.129529 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.129531 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.129531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.129906 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.130019 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.130293 (+ 274us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.130499 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":85,"server-negotiator.queue_time_us":212,"thread_start_us":132,"threads_started":1}
WARNING: no policy specified for kudu/127.15.37.61@KRBTEST.COM; defaulting to no policy
I20260810 21:09:12.131721 19197 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:09:12.132189 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.132045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:34393 (local address 127.0.0.1:59526)
0810 21:09:12.132104 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.132153 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:34393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 21:09:12.132403 19127 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.37.61:34393: connect: Connection refused (error 111)
I20260810 21:09:12.132993 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.132878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:34393 (local address 127.0.0.1:59540)
0810 21:09:12.132943 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.132969 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:34393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260810 21:09:12.133169 19197 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.61:34393: Network error: Client connection negotiation failed: client connection to 127.15.37.61:34393: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.61.keytab.
Entry for principal kudu/127.15.37.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.61.keytab.
I20260810 21:09:12.151997 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.61:34393
--webserver_interface=127.15.37.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.61.keytab
--principal=kudu/127.15.37.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:44001,127.15.37.61:34393,127.15.37.60:34869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:09:12.182451 19197 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } attempt: 1
I20260810 21:09:12.183053 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.182879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:34393 (local address 127.0.0.1:59546)
0810 21:09:12.182983 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.183019 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:34393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260810 21:09:12.183444 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.183339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:34393 (local address 127.0.0.1:59560)
0810 21:09:12.183388 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.183417 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:34393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 21:09:12.183531 19197 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.61:34393: Network error: Client connection negotiation failed: client connection to 127.15.37.61:34393: connect: Connection refused (error 111)
W20260810 21:09:12.242615 19211 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 21:09:12.243036 19211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:09:12.243124 19211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:09:12.243155 19211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:09:12.244511 19211 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:09:12.244565 19211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:09:12.244580 19211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:09:12.244593 19211 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:09:12.244606 19211 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:09:12.246965 19211 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:44001,127.15.37.61:34393,127.15.37.60:34869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.61.keytab
--principal=kudu/127.15.37.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.61:34393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.37.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:09:12.247299 19211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:09:12.247617 19211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 21:09:12.251673 19197 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } attempt: 2
I20260810 21:09:12.252349 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.252138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:34393 (local address 127.0.0.1:59566)
0810 21:09:12.252257 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.252301 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:34393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260810 21:09:12.252951 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.252844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:34393 (local address 127.0.0.1:59572)
0810 21:09:12.252881 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.252925 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:34393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260810 21:09:12.253108 19197 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.61:34393: Network error: Client connection negotiation failed: client connection to 127.15.37.61:34393: connect: Connection refused (error 111)
W20260810 21:09:12.253206 19224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:12.253214 19221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:12.253324 19220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:12.253736 19211 server_base.cc:1034] running on GCE node
I20260810 21:09:12.254046 19211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:09:12.254416 19211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:09:12.255614 19211 hybrid_clock.cc:648] HybridClock initialized: now 1786396152255588 us; error 40 us; skew 500 ppm
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:09:12.258742 19211 init.cc:377] Logged in from keytab as kudu/127.15.37.61@KRBTEST.COM (short username kudu)
I20260810 21:09:12.259418 19211 webserver.cc:460] Webserver started at http://127.15.37.61:33361/ using document root <none> and password file <none>
I20260810 21:09:12.259687 19211 fs_manager.cc:359] Metadata directory not provided
I20260810 21:09:12.259759 19211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:09:12.259931 19211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:09:12.261224 19211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/data/instance:
uuid: "944d947b968742e399cd2946f047b8b6"
format_stamp: "Formatted at 2026-08-10 21:09:12 on dist-test-slave-jq4t"
server_key: "a5532cfe28227ba8532a23f8d459759a"
server_key_iv: "0c5e7291efe4a492851eeee46baec49b"
server_key_version: "encryptionkey@0"
I20260810 21:09:12.261641 19211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/wal/instance:
uuid: "944d947b968742e399cd2946f047b8b6"
format_stamp: "Formatted at 2026-08-10 21:09:12 on dist-test-slave-jq4t"
server_key: "a5532cfe28227ba8532a23f8d459759a"
server_key_iv: "0c5e7291efe4a492851eeee46baec49b"
server_key_version: "encryptionkey@0"
I20260810 21:09:12.263401 19211 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260810 21:09:12.264807 19235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:09:12.265116 19211 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:09:12.265259 19211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/wal
uuid: "944d947b968742e399cd2946f047b8b6"
format_stamp: "Formatted at 2026-08-10 21:09:12 on dist-test-slave-jq4t"
server_key: "a5532cfe28227ba8532a23f8d459759a"
server_key_iv: "0c5e7291efe4a492851eeee46baec49b"
server_key_version: "encryptionkey@0"
I20260810 21:09:12.265362 19211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:09:12.277016 19211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:09:12.279379 19211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:09:12.279567 19211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:09:12.284190 19211 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.61:34393
I20260810 21:09:12.284328 19316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.61:34393 every 8 connection(s)
I20260810 21:09:12.284703 19211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/data/info.pb
I20260810 21:09:12.285791 19318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:09:12.287492 19318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:09:12.288842 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 19211
I20260810 21:09:12.288987 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-1/wal/instance
I20260810 21:09:12.289201 15508 external_mini_cluster.cc:1428] Setting key 8f7906d402085182790009d2fe735fb0
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.61@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.37.60@KRBTEST.COM; defaulting to no policy
I20260810 21:09:12.299979 19205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.288298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55584 (local address 127.15.37.62:44001)
0810 21:09:12.288367 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.288369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.288675 (+ 306us) server_negotiation.cc:407] Connection header received
0810 21:09:12.289463 (+ 788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.289465 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.289490 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.289555 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.290617 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.291513 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.293160 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.293391 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.293480 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.296529 (+ 3049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.296532 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.296532 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.296542 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.298325 (+ 1783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.298901 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.298902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.298902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.298964 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.299269 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.299270 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.299270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.299389 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.299442 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.299828 (+ 386us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.299904 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 21:09:12.300276 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.288244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44001 (local address 127.0.0.1:55584)
0810 21:09:12.288464 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.288556 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:12.289296 (+ 740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:12.289669 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:12.289673 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:12.290095 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:12.290429 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.290436 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.291624 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.291626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.293035 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.293039 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.293509 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.293511 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.293691 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.294310 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:12.294322 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:12.296331 (+ 2009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:12.298425 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.298435 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.298439 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.298796 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.299039 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.299041 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.299041 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.299198 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.299462 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:12.299472 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:12.299672 (+ 200us) client_negotiation.cc:769] Sending connection context
0810 21:09:12.299805 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 21:09:12.299994 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":110,"threads_started":1}
I20260810 21:09:12.300978 19318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.60@KRBTEST.COM" created.
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.61@KRBTEST.COM for kudu/127.15.37.61@KRBTEST.COM
I20260810 21:09:12.309062 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.301299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:34393 (local address 127.0.0.1:59588)
0810 21:09:12.301356 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.301369 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:12.301416 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:12.301740 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:12.301741 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:12.301893 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:12.301949 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.301951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.303116 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.303117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.303627 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.303629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.304138 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.304139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.304209 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.304724 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:12.304729 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:12.305951 (+ 1222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:12.307824 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.307825 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.307825 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.308003 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.308227 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.308228 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.308228 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.308288 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.308665 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:12.308666 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:12.308709 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 21:09:12.308798 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 21:09:12.308921 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 21:09:12.309082 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.301371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59588 (local address 127.15.37.61:34393)
0810 21:09:12.301600 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.301604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.301621 (+ 17us) server_negotiation.cc:407] Connection header received
0810 21:09:12.301640 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.301641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.301652 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.301740 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.302037 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.303018 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.303712 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.304046 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.304140 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.306046 (+ 1906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.306056 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.306057 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.306064 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.307719 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.308087 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.308090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.308091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.308152 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.308350 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.308351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.308352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.308585 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.308681 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.308843 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.308978 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":204,"thread_start_us":117,"threads_started":1}
I20260810 21:09:12.310058 19318 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:09:12.310457 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.310327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34869 (local address 127.0.0.1:60902)
0810 21:09:12.310377 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.310427 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 21:09:12.310607 19245 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
I20260810 21:09:12.311060 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.310950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34869 (local address 127.0.0.1:60910)
0810 21:09:12.311005 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.311030 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 21:09:12.311163 19318 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:34869: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.60.keytab.
Entry for principal kudu/127.15.37.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.60.keytab.
I20260810 21:09:12.319932 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.60:34869
--webserver_interface=127.15.37.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.60.keytab
--principal=kudu/127.15.37.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:36151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:44001,127.15.37.61:34393,127.15.37.60:34869
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:09:12.344333 19197 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } attempt: 3
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for kudu/127.15.37.61@KRBTEST.COM
I20260810 21:09:12.352460 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.344863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:34393 (local address 127.0.0.1:59602)
0810 21:09:12.344955 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.344967 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:12.345016 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:12.345178 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:12.345179 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:12.345396 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:12.345481 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.345483 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.346172 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.346173 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.347022 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.347025 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.347425 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.347426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.347508 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.348012 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:12.348018 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:12.349490 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:12.351285 (+ 1795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.351286 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.351287 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.351488 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.351713 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.351714 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.351715 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.351785 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.352076 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:12.352077 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:12.352133 (+ 56us) client_negotiation.cc:769] Sending connection context
0810 21:09:12.352226 (+ 93us) client_negotiation.cc:240] Negotiation successful
0810 21:09:12.352348 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260810 21:09:12.352460 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.344965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59602 (local address 127.15.37.61:34393)
0810 21:09:12.345031 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.345033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.345044 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:09:12.345072 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.345073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.345083 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.345149 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.345565 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.346079 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.347114 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.347348 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.347402 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.349616 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.349618 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.349618 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.349626 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.351178 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.351574 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.351575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.351576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.351641 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.351856 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.351857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.351858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.352003 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.352085 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.352254 (+ 169us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.352350 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 21:09:12.353317 19197 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:09:12.353756 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.353619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34869 (local address 127.0.0.1:60926)
0810 21:09:12.353679 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.353722 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 21:09:12.354176 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.354073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34869 (local address 127.0.0.1:60942)
0810 21:09:12.354127 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.354155 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260810 21:09:12.354353 19197 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:34869: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
I20260810 21:09:12.360387 19318 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } attempt: 1
I20260810 21:09:12.360997 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.360850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34869 (local address 127.0.0.1:60952)
0810 21:09:12.360919 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.360958 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260810 21:09:12.361485 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.361346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34869 (local address 127.0.0.1:60960)
0810 21:09:12.361424 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.361454 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260810 21:09:12.361724 19318 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:34869: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
I20260810 21:09:12.385556 19197 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } attempt: 1
I20260810 21:09:12.386142 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.385982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34869 (local address 127.0.0.1:60968)
0810 21:09:12.386063 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.386109 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 21:09:12.386699 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.386409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34869 (local address 127.0.0.1:60982)
0810 21:09:12.386623 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.386668 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
W20260810 21:09:12.387001 19197 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:34869: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
W20260810 21:09:12.412304 19331 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 21:09:12.412672 19331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:09:12.412714 19331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:09:12.412760 19331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:09:12.413937 19331 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:09:12.414012 19331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:09:12.414037 19331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:09:12.414058 19331 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:09:12.414088 19331 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:09:12.415704 19331 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:36151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:44001,127.15.37.61:34393,127.15.37.60:34869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.60.keytab
--principal=kudu/127.15.37.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.60:34869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.37.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:09:12.416031 19331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:09:12.416290 19331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:09:12.421555 19344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:12.421721 19331 server_base.cc:1034] running on GCE node
W20260810 21:09:12.421559 19340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:12.421609 19339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:12.422179 19331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:09:12.422534 19331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:09:12.423724 19331 hybrid_clock.cc:648] HybridClock initialized: now 1786396152423710 us; error 46 us; skew 500 ppm
I20260810 21:09:12.429893 19318 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } attempt: 2
I20260810 21:09:12.430406 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.430259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34869 (local address 127.0.0.1:60988)
0810 21:09:12.430328 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.430371 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 21:09:12.430893 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.430759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34869 (local address 127.0.0.1:60998)
0810 21:09:12.430828 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.430862 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 21:09:12.431056 19318 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:34869: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34869: connect: Connection refused (error 111)
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:09:12.431792 19331 init.cc:377] Logged in from keytab as kudu/127.15.37.60@KRBTEST.COM (short username kudu)
I20260810 21:09:12.432271 19331 webserver.cc:460] Webserver started at http://127.15.37.60:39909/ using document root <none> and password file <none>
I20260810 21:09:12.432611 19331 fs_manager.cc:359] Metadata directory not provided
I20260810 21:09:12.432693 19331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:09:12.432842 19331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:09:12.434001 19331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/data/instance:
uuid: "c85eaf770ff945a0ae05ae920ef2ab21"
format_stamp: "Formatted at 2026-08-10 21:09:12 on dist-test-slave-jq4t"
server_key: "baf8cc1624df602dbeb65f28d088a1d7"
server_key_iv: "675509616547086fa435d12a776e3c80"
server_key_version: "encryptionkey@0"
I20260810 21:09:12.434394 19331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/wal/instance:
uuid: "c85eaf770ff945a0ae05ae920ef2ab21"
format_stamp: "Formatted at 2026-08-10 21:09:12 on dist-test-slave-jq4t"
server_key: "baf8cc1624df602dbeb65f28d088a1d7"
server_key_iv: "675509616547086fa435d12a776e3c80"
server_key_version: "encryptionkey@0"
I20260810 21:09:12.435938 19331 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:09:12.436918 19357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:09:12.437124 19331 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:09:12.437235 19331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/wal
uuid: "c85eaf770ff945a0ae05ae920ef2ab21"
format_stamp: "Formatted at 2026-08-10 21:09:12 on dist-test-slave-jq4t"
server_key: "baf8cc1624df602dbeb65f28d088a1d7"
server_key_iv: "675509616547086fa435d12a776e3c80"
server_key_version: "encryptionkey@0"
I20260810 21:09:12.437325 19331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:09:12.445951 19331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:09:12.448465 19331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:09:12.448690 19331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:09:12.453547 19331 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.60:34869
I20260810 21:09:12.453580 19434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.60:34869 every 8 connection(s)
I20260810 21:09:12.453994 19331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/data/info.pb
I20260810 21:09:12.455056 19435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:09:12.456444 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 19331
I20260810 21:09:12.456604 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786395855004795-15508-0/minicluster-data/master-2/wal/instance
I20260810 21:09:12.456815 15508 external_mini_cluster.cc:1428] Setting key 90d2e63c0ef54a07949c7502faa28bfd
I20260810 21:09:12.457027 19435 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:09:12.462177 19197 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } attempt: 2
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.60@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.60@KRBTEST.COM
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for kudu/127.15.37.60@KRBTEST.COM
I20260810 21:09:12.468370 19205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.457854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55594 (local address 127.15.37.62:44001)
0810 21:09:12.457933 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.457935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.458128 (+ 193us) server_negotiation.cc:407] Connection header received
0810 21:09:12.458276 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.458277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.458289 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.458362 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.459170 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.459971 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.461229 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.461502 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.461578 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.464528 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.464530 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.464531 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.464539 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.466374 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.467001 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.467002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.467003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.467065 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.467349 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.467350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.467351 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.467505 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.467596 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.468171 (+ 575us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.468260 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 21:09:12.469033 19441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.457428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32772 (local address 127.15.37.60:34869)
0810 21:09:12.457624 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.457632 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.457659 (+ 27us) server_negotiation.cc:407] Connection header received
0810 21:09:12.458199 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.458206 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.458244 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.458353 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.459179 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.460270 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.461344 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.461767 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.461819 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.464941 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.464951 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.464951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.464960 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.467047 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.467475 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.467478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.467479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.467539 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.467751 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.467752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.467753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.468049 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.468730 (+ 681us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.468786 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.468893 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":99,"threads_started":1}
I20260810 21:09:12.469061 19444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.457801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:44001 (local address 127.0.0.1:55594)
0810 21:09:12.458001 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.458040 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:12.458197 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:12.458404 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:12.458407 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:12.458811 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:12.459077 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.459082 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.460060 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.460061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.461146 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.461149 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.461614 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.461615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.461712 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.462356 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:12.462368 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:12.464389 (+ 2021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:12.466477 (+ 2088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.466487 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.466489 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.466894 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.467140 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.467141 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.467141 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.467288 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.467897 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:12.467902 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:12.468043 (+ 141us) client_negotiation.cc:769] Sending connection context
0810 21:09:12.468145 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 21:09:12.468316 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":80,"threads_started":1}
I20260810 21:09:12.469949 19435 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:09:12.472378 19203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.462588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34869 (local address 127.0.0.1:32784)
0810 21:09:12.462646 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.462656 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:12.462695 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:12.462945 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:12.462946 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:12.463132 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:12.463185 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.463187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.464126 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.464128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.464979 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.464982 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.465461 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.465462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.465528 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.465865 (+ 337us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:12.465870 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:12.467498 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:12.471108 (+ 3610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.471110 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.471110 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.471386 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.471625 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.471626 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.471626 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.471696 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.472020 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:12.472022 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:12.472068 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 21:09:12.472160 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 21:09:12.472268 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 21:09:12.472469 19445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.462646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32784 (local address 127.15.37.60:34869)
0810 21:09:12.462783 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.462785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.462793 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:09:12.462813 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.462814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.462824 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.462920 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.463274 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.464037 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.465071 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.465395 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.465462 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.467589 (+ 2127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.467590 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.467590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.467598 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.471015 (+ 3417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.471468 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.471469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.471470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.471545 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.471761 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.471762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.471762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.471940 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.472017 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.472187 (+ 170us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.472268 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":116,"thread_start_us":81,"threads_started":1}
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.60@KRBTEST.COM for kudu/127.15.37.61@KRBTEST.COM
I20260810 21:09:12.475230 19197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057: Bootstrap starting.
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:09:12.476127 19197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057: Neither blocks nor log segments found. Creating new log.
I20260810 21:09:12.476584 19197 log.cc:824] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057: Log is configured to *not* fsync() on all Append() calls
I20260810 21:09:12.477702 19197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057: No bootstrap required, opened a new log
I20260810 21:09:12.478259 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.470259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59618 (local address 127.15.37.61:34393)
0810 21:09:12.470317 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.470320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.470371 (+ 51us) server_negotiation.cc:407] Connection header received
0810 21:09:12.470443 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.470444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.470458 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.470521 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.470962 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.471719 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.472747 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.473066 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.473115 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.475163 (+ 2048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.475164 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.475165 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.475173 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.476975 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.477390 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.477392 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.477392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.477460 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.477676 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.477677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.477678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.477840 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.477915 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.478076 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.478162 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 21:09:12.478262 19444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.470192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:34393 (local address 127.0.0.1:59618)
0810 21:09:12.470312 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.470324 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:12.470386 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:12.470577 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:12.470579 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:12.470794 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:12.470857 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.470859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.471817 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.471818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.472652 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.472655 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.473200 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.473201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.473262 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.473749 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:12.473755 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:12.475065 (+ 1310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:12.477075 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.477076 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.477076 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.477288 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.477531 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.477532 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.477533 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.477595 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.477906 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:12.477907 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:12.477957 (+ 50us) client_negotiation.cc:769] Sending connection context
0810 21:09:12.478048 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 21:09:12.478162 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":2}
I20260810 21:09:12.479508 19205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.470458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55604 (local address 127.15.37.62:44001)
0810 21:09:12.470498 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.470500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.470565 (+ 65us) server_negotiation.cc:407] Connection header received
0810 21:09:12.470634 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.470635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.470645 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.470700 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.471313 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.471997 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.472970 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.473216 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.473299 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.476165 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.476166 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.476167 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.476175 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.477997 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.478783 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.478784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.478785 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.478840 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.479068 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.479068 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.479069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.479165 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.479284 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.479388 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.479453 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 21:09:12.480265 19197 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } }
I20260810 21:09:12.480535 19435 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:09:12.480437 19197 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39dafdc149514634aea29855c4c9b057, State: Initialized, Role: FOLLOWER
I20260810 21:09:12.480770 19197 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } }
I20260810 21:09:12.481114 19450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } } }
I20260810 21:09:12.481209 19197 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:09:12.481231 19450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 21:09:12.483222 19465 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:09:12.483287 19465 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.60@KRBTEST.COM for kudu/127.15.37.60@KRBTEST.COM
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.61@KRBTEST.COM
I20260810 21:09:12.483964 19098 master_runner.cc:186] Error getting master registration for 127.15.37.61:34393: OK, instance_id { permanent_uuid: "944d947b968742e399cd2946f047b8b6" instance_seqno: 1786396152282836 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 21:09:12.487418 19098 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 21:09:12.489738 19444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.480809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34869 (local address 127.0.0.1:32800)
0810 21:09:12.480886 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.480895 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:12.480931 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:12.481584 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:12.481586 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:12.481750 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:12.481790 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.481791 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.482764 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.482765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.483484 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.483487 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.483961 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.483962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.484011 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.484333 (+ 322us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:12.484339 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:12.486551 (+ 2212us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:12.488513 (+ 1962us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.488515 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.488515 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.488701 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.488956 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.488957 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.488957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.489021 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.489355 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:12.489356 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:12.489399 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 21:09:12.489488 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 21:09:12.489624 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":2}
I20260810 21:09:12.489784 19445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.480895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32800 (local address 127.15.37.60:34869)
0810 21:09:12.481381 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.481384 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.481393 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:09:12.481419 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.481420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.481432 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.481493 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.481877 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.482664 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.483571 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.483842 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.483913 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.486647 (+ 2734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.486648 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.486649 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.486657 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.488396 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.488805 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.488807 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.488807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.488876 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.489100 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.489101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.489101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.489275 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.489359 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.489511 (+ 152us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.489675 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":85,"server-negotiator.queue_time_us":461}
I20260810 21:09:12.491114 19435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21: Bootstrap starting.
I20260810 21:09:12.491746 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.480452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59632 (local address 127.15.37.61:34393)
0810 21:09:12.480522 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.480524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.480587 (+ 63us) server_negotiation.cc:407] Connection header received
0810 21:09:12.480691 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.480692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.480704 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.480760 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.481596 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.482259 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.483252 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.483555 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.483622 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.487389 (+ 3767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.487391 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.487391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.487399 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.489687 (+ 2288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.490481 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.490483 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.490483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.490547 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.490767 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.490768 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.490768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.490921 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.491078 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.491567 (+ 489us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.491650 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 21:09:12.491781 19435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21: Neither blocks nor log segments found. Creating new log.
I20260810 21:09:12.492168 19435 log.cc:824] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21: Log is configured to *not* fsync() on all Append() calls
I20260810 21:09:12.493099 19435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21: No bootstrap required, opened a new log
I20260810 21:09:12.493427 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:09:12.494592 19155 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "39dafdc149514634aea29855c4c9b057"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55604
I20260810 21:09:12.494763 19155 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 21:09:12.494814 19155 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:09:12.495105 19435 raft_consensus.cc:348] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } }
I20260810 21:09:12.495249 19435 raft_consensus.cc:729] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c85eaf770ff945a0ae05ae920ef2ab21, State: Initialized, Role: FOLLOWER
I20260810 21:09:12.495325 19435 consensus_queue.cc:260] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } }
I20260810 21:09:12.495688 19435 sys_catalog.cc:564] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:09:12.495653 19469 sys_catalog.cc:455] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } } }
I20260810 21:09:12.495752 19469 sys_catalog.cc:458] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:09:12.495784 19155 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } }
I20260810 21:09:12.496069 19155 leader_election.cc:288] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [CANDIDATE]: Term 1 election: Requested vote from peers 944d947b968742e399cd2946f047b8b6 (127.15.37.61:34393), c85eaf770ff945a0ae05ae920ef2ab21 (127.15.37.60:34869)
I20260810 21:09:12.496421 19397 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39dafdc149514634aea29855c4c9b057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c85eaf770ff945a0ae05ae920ef2ab21"
I20260810 21:09:12.496592 19397 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:09:12.497746 19397 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39dafdc149514634aea29855c4c9b057 in term 1.
I20260810 21:09:12.498052 19129 leader_election.cc:302] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39dafdc149514634aea29855c4c9b057, c85eaf770ff945a0ae05ae920ef2ab21; no voters:
I20260810 21:09:12.498168 19450 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:09:12.498323 19450 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [term 1 LEADER]: Becoming Leader. State: Replica: 39dafdc149514634aea29855c4c9b057, State: Running, Role: LEADER
I20260810 21:09:12.498425 19450 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } }
I20260810 21:09:12.498869 19450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39dafdc149514634aea29855c4c9b057. Latest consensus state: current_term: 1 leader_uuid: "39dafdc149514634aea29855c4c9b057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } } }
I20260810 21:09:12.498945 19450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:12.499811 19507 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:09:12.500033 19507 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260810 21:09:12.501890 19494 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:09:12.501945 19494 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:09:12.502952 19397 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21 [term 1 FOLLOWER]: Refusing update from remote peer 39dafdc149514634aea29855c4c9b057: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:09:12.500983 19331 master_runner.cc:186] Error getting master registration for 127.15.37.61:34393: OK, instance_id { permanent_uuid: "944d947b968742e399cd2946f047b8b6" instance_seqno: 1786396152282836 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 21:09:12.503171 19331 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 21:09:12.503367 19450 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:09:12.504618 19469 sys_catalog.cc:455] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39dafdc149514634aea29855c4c9b057. Latest consensus state: current_term: 1 leader_uuid: "39dafdc149514634aea29855c4c9b057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } } }
I20260810 21:09:12.504738 19469 sys_catalog.cc:458] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:09:12.506494 19450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39dafdc149514634aea29855c4c9b057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } } }
I20260810 21:09:12.506604 19450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:12.506970 19469 sys_catalog.cc:455] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39dafdc149514634aea29855c4c9b057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } } }
I20260810 21:09:12.507063 19469 sys_catalog.cc:458] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:09:12.507357 19507 catalog_manager.cc:1347] Generated new cluster ID: 6aeee8b286074e76865c0746e79ffded
I20260810 21:09:12.507405 19507 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:09:12.509582 19205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.497604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55618 (local address 127.15.37.62:44001)
0810 21:09:12.497651 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.497653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.500632 (+ 2979us) server_negotiation.cc:407] Connection header received
0810 21:09:12.500731 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.500732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.500743 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.500796 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.501607 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.502319 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.503624 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.503933 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.503997 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.506541 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.506543 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.506543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.506550 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.508311 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.508719 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.508721 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.508721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.508773 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.508942 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.508943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.508943 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.509058 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.509153 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.509372 (+ 219us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.509466 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 21:09:12.512598 19508 mvcc.cc:205] Tried to move back new op lower bound from 7317078640649330688 to 7317078640634347520. Current Snapshot: MvccSnapshot[applied={T|T < 7317078640649330688 or (T in {7317078640649330688})}]
I20260810 21:09:12.517897 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.498080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59640 (local address 127.15.37.61:34393)
0810 21:09:12.498128 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.498130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.504628 (+ 6498us) server_negotiation.cc:407] Connection header received
0810 21:09:12.504739 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.504741 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.504752 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.504785 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.505623 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.506354 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.507321 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.507657 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.507722 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.509604 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.509605 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.509605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.509613 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.511310 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.516956 (+ 5646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.516958 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.516958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.517034 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.517251 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.517252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.517252 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.517438 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.517538 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.517697 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.517792 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 21:09:12.521472 19510 mvcc.cc:205] Tried to move back new op lower bound from 7317078640649330688 to 7317078640634347520. Current Snapshot: MvccSnapshot[applied={T|T < 7317078640649330688}]
I20260810 21:09:12.522277 19445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.498902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32808 (local address 127.15.37.60:34869)
0810 21:09:12.498940 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.498942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.507421 (+ 8479us) server_negotiation.cc:407] Connection header received
0810 21:09:12.507508 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.507508 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.507519 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.507551 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.508208 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.509026 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.510792 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.511119 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.511182 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.512462 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.512463 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.512463 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.512497 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.514471 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.520891 (+ 6420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.520894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.520894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.520978 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.521342 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.521343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.521343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.521506 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.521600 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.522080 (+ 480us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.522181 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 21:09:12.522225 19318 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } attempt: 3
Aug 10 21:09:12 dist-test-slave-jq4t krb5kdc[19078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396152, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.61@KRBTEST.COM for kudu/127.15.37.60@KRBTEST.COM
I20260810 21:09:12.530889 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.522514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34869 (local address 127.0.0.1:32810)
0810 21:09:12.522606 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:12.522617 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:12.522655 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:12.522936 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:12.522937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:12.523117 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:12.523172 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.523174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.524297 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.524298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.525139 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:12.525141 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.525626 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.525627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:12.525688 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.526318 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:12.526324 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:12.527869 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:12.529712 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.529713 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.529713 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.529947 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.530168 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:12.530168 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:12.530169 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:12.530227 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:12.530512 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:12.530513 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:12.530560 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 21:09:12.530608 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 21:09:12.530722 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260810 21:09:12.531343 19445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:12.522763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32810 (local address 127.15.37.60:34869)
0810 21:09:12.522799 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.522801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.522807 (+ 6us) server_negotiation.cc:407] Connection header received
0810 21:09:12.522827 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.522828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.522838 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.523334 (+ 496us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.523364 (+ 30us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.524197 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.525244 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:12.525543 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:12.526123 (+ 580us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:12.527968 (+ 1845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:12.527970 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:12.527970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:12.527977 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:12.529609 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.530036 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.530037 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.530038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.530096 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:12.530298 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:12.530299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:12.530299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:12.530435 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:12.531118 (+ 683us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:12.531164 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 21:09:12.531250 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 21:09:12.533129 19318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6: Bootstrap starting.
I20260810 21:09:12.533978 19318 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6: Neither blocks nor log segments found. Creating new log.
I20260810 21:09:12.534330 19318 log.cc:824] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6: Log is configured to *not* fsync() on all Append() calls
I20260810 21:09:12.545193 19507 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:09:12.546069 19507 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:09:12.549417 19318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6: No bootstrap required, opened a new log
I20260810 21:09:12.551715 19318 raft_consensus.cc:348] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } }
I20260810 21:09:12.551895 19318 raft_consensus.cc:729] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 944d947b968742e399cd2946f047b8b6, State: Initialized, Role: FOLLOWER
I20260810 21:09:12.551980 19318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } }
I20260810 21:09:12.552351 19518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } } }
I20260810 21:09:12.552506 19518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:09:12.553620 19279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39dafdc149514634aea29855c4c9b057" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "944d947b968742e399cd2946f047b8b6"
I20260810 21:09:12.553763 19279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:09:12.552374 19318 sys_catalog.cc:564] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:09:12.556578 19279 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39dafdc149514634aea29855c4c9b057 in term 1.
I20260810 21:09:12.556878 19278 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6 [term 1 FOLLOWER]: Refusing update from remote peer 39dafdc149514634aea29855c4c9b057: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:09:12.556969 19507 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057: Generated new TSK 0
I20260810 21:09:12.557225 19507 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 21:09:12.557579 19514 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [LEADER]: Connected to new peer: Peer: permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:09:12.560045 19518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39dafdc149514634aea29855c4c9b057. Latest consensus state: current_term: 1 leader_uuid: "39dafdc149514634aea29855c4c9b057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } } }
I20260810 21:09:12.560139 19518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:09:12.560175 19518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39dafdc149514634aea29855c4c9b057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } } }
I20260810 21:09:12.560214 19518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 21:09:12.562269 19539 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:09:12.562405 19539 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:09:12.565124 19534 mvcc.cc:205] Tried to move back new op lower bound from 7317078640854708224 to 7317078640634347520. Current Snapshot: MvccSnapshot[applied={T|T < 7317078640649330688}]
W20260810 21:09:12.586257 19445 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:12.584169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32818 (local address 127.15.37.60:34869)
0810 21:09:12.584220 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.584222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.585466 (+ 1244us) server_negotiation.cc:407] Connection header received
0810 21:09:12.585588 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.585589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.585603 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.585636 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.586172 (+ 536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32818: BlockingRecv error: recv got EOF from 127.0.0.1:32818 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260810 21:09:12.587111 19205 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:12.584692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55630 (local address 127.15.37.62:44001)
0810 21:09:12.584738 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.584740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.586553 (+ 1813us) server_negotiation.cc:407] Connection header received
0810 21:09:12.586655 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.586657 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.586669 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.586700 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.587040 (+ 340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55630: BlockingRecv error: recv got EOF from 127.0.0.1:55630 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260810 21:09:12.587900 19326 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:12.585073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59644 (local address 127.15.37.61:34393)
0810 21:09:12.585117 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.585119 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.587354 (+ 2235us) server_negotiation.cc:407] Connection header received
0810 21:09:12.587468 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.587469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.587482 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.587514 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.587834 (+ 320us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59644: BlockingRecv error: recv got EOF from 127.0.0.1:59644 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260810 21:09:12.590405 19326 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:12.589602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59652 (local address 127.15.37.61:34393)
0810 21:09:12.589644 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.589645 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.589856 (+ 211us) server_negotiation.cc:407] Connection header received
0810 21:09:12.589964 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.589965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.589985 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.590016 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.590354 (+ 338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59652: BlockingRecv error: recv got EOF from 127.0.0.1:59652 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 21:09:12.593660 19326 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:12.592815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59664 (local address 127.15.37.61:34393)
0810 21:09:12.592853 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.592855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.593117 (+ 262us) server_negotiation.cc:407] Connection header received
0810 21:09:12.593210 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.593211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.593222 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.593251 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.593606 (+ 355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59664: BlockingRecv error: recv got EOF from 127.0.0.1:59664 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 21:09:12.598424 19326 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:12.597365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59668 (local address 127.15.37.61:34393)
0810 21:09:12.597406 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.597408 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.597744 (+ 336us) server_negotiation.cc:407] Connection header received
0810 21:09:12.597852 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.597853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.597865 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.597896 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.598344 (+ 448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59668: BlockingRecv error: recv got EOF from 127.0.0.1:59668 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260810 21:09:12.606343 19326 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:12.604006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59670 (local address 127.15.37.61:34393)
0810 21:09:12.604060 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.604062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.604372 (+ 310us) server_negotiation.cc:407] Connection header received
0810 21:09:12.604569 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.604571 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.604585 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.604621 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.606242 (+ 1621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59670: BlockingRecv error: recv got EOF from 127.0.0.1:59670 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260810 21:09:12.617312 19326 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:12.616086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59682 (local address 127.15.37.61:34393)
0810 21:09:12.616138 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.616141 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.616462 (+ 321us) server_negotiation.cc:407] Connection header received
0810 21:09:12.616718 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.616719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.616735 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.616769 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.617232 (+ 463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59682: BlockingRecv error: recv got EOF from 127.0.0.1:59682 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260810 21:09:12.636283 19326 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:12.635215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59698 (local address 127.15.37.61:34393)
0810 21:09:12.635267 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.635269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.635612 (+ 343us) server_negotiation.cc:407] Connection header received
0810 21:09:12.635732 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.635734 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.635748 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.635781 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.636216 (+ 435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59698: BlockingRecv error: recv got EOF from 127.0.0.1:59698 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260810 21:09:12.671367 19326 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:12.669970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59714 (local address 127.15.37.61:34393)
0810 21:09:12.670020 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.670022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.670408 (+ 386us) server_negotiation.cc:407] Connection header received
0810 21:09:12.670548 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.670550 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.670566 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.670604 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.671286 (+ 682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59714: BlockingRecv error: recv got EOF from 127.0.0.1:59714 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260810 21:09:12.737788 19326 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:12.737032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59720 (local address 127.15.37.61:34393)
0810 21:09:12.737109 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.737112 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.737145 (+ 33us) server_negotiation.cc:407] Connection header received
0810 21:09:12.737240 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.737241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.737255 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.737336 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.737698 (+ 362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59720: BlockingRecv error: recv got EOF from 127.0.0.1:59720 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260810 21:09:12.868101 19326 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:12.867284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59736 (local address 127.15.37.61:34393)
0810 21:09:12.867368 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:12.867370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:12.867460 (+ 90us) server_negotiation.cc:407] Connection header received
0810 21:09:12.867527 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:12.867528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:12.867539 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:12.867598 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:12.868032 (+ 434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59736: BlockingRecv error: recv got EOF from 127.0.0.1:59736 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260810 21:09:13.126503 19326 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:13.125784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59752 (local address 127.15.37.61:34393)
0810 21:09:13.125886 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:13.125888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:13.125896 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:09:13.125925 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:13.125926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:13.125937 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:13.126010 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:13.126417 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59752: BlockingRecv error: recv got EOF from 127.0.0.1:59752 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 21:09:13.129987 19514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39dafdc149514634aea29855c4c9b057" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39dafdc149514634aea29855c4c9b057" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 44001 } } peers { permanent_uuid: "944d947b968742e399cd2946f047b8b6" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 34393 } } peers { permanent_uuid: "c85eaf770ff945a0ae05ae920ef2ab21" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34869 } } }
I20260810 21:09:13.130174 19514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39dafdc149514634aea29855c4c9b057 [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:13.502466 19494 catalog_manager.cc:1259] Loaded cluster ID: 6aeee8b286074e76865c0746e79ffded
I20260810 21:09:13.502597 19494 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21: loading cluster ID for follower catalog manager: success
I20260810 21:09:13.503480 19494 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21: acquiring CA information for follower catalog manager: success
I20260810 21:09:13.503818 19494 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c85eaf770ff945a0ae05ae920ef2ab21: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 21:09:13.562994 19539 catalog_manager.cc:1259] Loaded cluster ID: 6aeee8b286074e76865c0746e79ffded
I20260810 21:09:13.563122 19539 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6: loading cluster ID for follower catalog manager: success
I20260810 21:09:13.564019 19539 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6: acquiring CA information for follower catalog manager: success
I20260810 21:09:13.564370 19539 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 944d947b968742e399cd2946f047b8b6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 21:09:13.642808 19646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:13.639857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59754 (local address 127.15.37.61:34393)
0810 21:09:13.640066 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:13.640068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:13.640080 (+ 12us) server_negotiation.cc:407] Connection header received
0810 21:09:13.640120 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:13.640121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:13.640181 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:13.640273 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:09:13.640437 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:13.641019 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:13.641895 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:13.642116 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:13.642200 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:13.642404 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:09:13.642536 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:09:13.642622 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:13.642663 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 21:09:13.642691 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":113,"threads_started":1}
I20260810 21:09:13.647203 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:13.644887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32822 (local address 127.15.37.60:34869)
0810 21:09:13.645000 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:13.645002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:13.645010 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:09:13.645054 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:13.645054 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:13.645103 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:13.645177 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:09:13.645267 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:13.645748 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:13.646453 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:13.646648 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:13.646698 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:13.646834 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:09:13.646964 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:09:13.647024 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:13.647059 (+ 35us) server_negotiation.cc:299] Negotiation successful
0810 21:09:13.647078 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":62,"threads_started":1}
I20260810 21:09:13.652160 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:13.649146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32830 (local address 127.15.37.60:34869)
0810 21:09:13.649261 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:13.649263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:13.649408 (+ 145us) server_negotiation.cc:407] Connection header received
0810 21:09:13.649465 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:13.649467 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:13.649478 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:13.649532 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:09:13.649676 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:13.650184 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:13.651189 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:13.651498 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:13.651563 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:13.651712 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:09:13.651748 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:09:13.651802 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:13.652047 (+ 245us) server_negotiation.cc:299] Negotiation successful
0810 21:09:13.652075 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260810 21:09:13.652354 19646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:13.649284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59768 (local address 127.15.37.61:34393)
0810 21:09:13.649335 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:13.649337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:13.649348 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:09:13.649380 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:13.649381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:13.649393 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:13.649448 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:09:13.649628 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:13.650406 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:13.651487 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:13.651813 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:13.651853 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:13.652038 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:09:13.652077 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:09:13.652130 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:13.652225 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 21:09:13.652254 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 21:09:13.652743 19665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:13.649103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55640 (local address 127.15.37.62:44001)
0810 21:09:13.649393 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:13.649395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:13.649403 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:09:13.649480 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:13.649481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:13.649541 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:13.649630 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:09:13.649751 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:13.650502 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:13.651473 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:13.651811 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:13.651871 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:13.652082 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:09:13.652208 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:09:13.652270 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:13.652524 (+ 254us) server_negotiation.cc:299] Negotiation successful
0810 21:09:13.652553 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":81,"threads_started":1}
I20260810 21:09:13.654894 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 19098
I20260810 21:09:13.685472 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 19211
I20260810 21:09:13.700768 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 19331
2026-08-10T21:09:13Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3160 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 21:09:13 dist-test-slave-jq4t krb5kdc[19676](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 21:09:13 dist-test-slave-jq4t krb5kdc[19676](info): set up 2 sockets
Aug 10 21:09:13 dist-test-slave-jq4t krb5kdc[19676](info): commencing operation
krb5kdc: starting...
W20260810 21:09:14.989780 15508 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/test-user.keytab.
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T21:09:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T21:09:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.15.37.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
Entry for principal kudu/127.15.37.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab.
I20260810 21:09:15.132007 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:40069
--webserver_interface=127.15.37.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:38237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:40069,127.15.37.61:43185,127.15.37.60:34401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 21:09:15.220667 19698 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 21:09:15.220971 19698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:09:15.221004 19698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:09:15.221050 19698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:09:15.222313 19698 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:09:15.222410 19698 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:09:15.222437 19698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:09:15.222465 19698 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:09:15.222496 19698 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:09:15.224154 19698 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:38237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:40069,127.15.37.61:43185,127.15.37.60:34401
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.62.keytab
--principal=kudu/127.15.37.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.62:40069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.37.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:09:15.224509 19698 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:09:15.224778 19698 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:09:15.230123 19711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:15.230144 19709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:15.230156 19704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:15.230485 19698 server_base.cc:1034] running on GCE node
I20260810 21:09:15.230808 19698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:09:15.231156 19698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:09:15.232316 19698 hybrid_clock.cc:648] HybridClock initialized: now 1786396155232293 us; error 47 us; skew 500 ppm
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:09:15.235153 19698 init.cc:377] Logged in from keytab as kudu/127.15.37.62@KRBTEST.COM (short username kudu)
I20260810 21:09:15.235607 19698 webserver.cc:460] Webserver started at http://127.15.37.62:44041/ using document root <none> and password file <none>
I20260810 21:09:15.235896 19698 fs_manager.cc:359] Metadata directory not provided
I20260810 21:09:15.235975 19698 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:09:15.236140 19698 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:09:15.237393 19698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/data/instance:
uuid: "bc6304bdc98d4ebf8d703779e1a117e2"
format_stamp: "Formatted at 2026-08-10 21:09:15 on dist-test-slave-jq4t"
server_key: "a4eb71c4261038599a3eafe2f8759b00"
server_key_iv: "1439cd07cf03b039d4f371708fd8178d"
server_key_version: "encryptionkey@0"
I20260810 21:09:15.237782 19698 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/wal/instance:
uuid: "bc6304bdc98d4ebf8d703779e1a117e2"
format_stamp: "Formatted at 2026-08-10 21:09:15 on dist-test-slave-jq4t"
server_key: "a4eb71c4261038599a3eafe2f8759b00"
server_key_iv: "1439cd07cf03b039d4f371708fd8178d"
server_key_version: "encryptionkey@0"
I20260810 21:09:15.239332 19698 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 21:09:15.240195 19719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:09:15.240392 19698 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:09:15.240525 19698 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/wal
uuid: "bc6304bdc98d4ebf8d703779e1a117e2"
format_stamp: "Formatted at 2026-08-10 21:09:15 on dist-test-slave-jq4t"
server_key: "a4eb71c4261038599a3eafe2f8759b00"
server_key_iv: "1439cd07cf03b039d4f371708fd8178d"
server_key_version: "encryptionkey@0"
I20260810 21:09:15.240621 19698 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:09:15.260871 19698 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:09:15.263226 19698 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:09:15.263441 19698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:09:15.267855 19698 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.62:40069
I20260810 21:09:15.267899 19805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.62:40069 every 8 connection(s)
I20260810 21:09:15.268306 19698 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/data/info.pb
I20260810 21:09:15.269155 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 19698
I20260810 21:09:15.269286 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-0/wal/instance
I20260810 21:09:15.269500 15508 external_mini_cluster.cc:1428] Setting key 8ec15bee0c3a1273b01485c8d25fb12a
I20260810 21:09:15.269663 19806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:09:15.271627 19806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.15.37.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.61@KRBTEST.COM" created.
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:09:15.288196 19814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.272969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55782 (local address 127.15.37.62:40069)
0810 21:09:15.274015 (+ 1046us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.274020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.274038 (+ 18us) server_negotiation.cc:407] Connection header received
0810 21:09:15.274122 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.274124 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.274146 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.274243 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.274984 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.276039 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.277620 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.277986 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.278097 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.284281 (+ 6184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.284296 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.284296 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.284307 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.286318 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.286902 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.286905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.286906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.287000 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.287278 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.287279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.287279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.287560 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.287632 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.287879 (+ 247us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.288005 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":1015,"thread_start_us":47,"threads_started":1}
I20260810 21:09:15.288322 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.272736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:40069 (local address 127.0.0.1:55782)
0810 21:09:15.272956 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.273012 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:15.273800 (+ 788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:15.274290 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:15.274293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:15.274586 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:15.274849 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.274854 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.276168 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.276170 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.277494 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.277499 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.278133 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.278136 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.278230 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.278930 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:15.278943 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:15.284141 (+ 5198us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:15.286449 (+ 2308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.286459 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.286462 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.286798 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.287078 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.287079 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.287079 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.287209 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.287637 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:15.287644 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:15.287732 (+ 88us) client_negotiation.cc:769] Sending connection context
0810 21:09:15.287838 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 21:09:15.288114 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":81,"thread_start_us":99,"threads_started":1}
I20260810 21:09:15.289263 19806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:09:15.289728 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.289561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:43185 (local address 127.0.0.1:41288)
0810 21:09:15.289624 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.289687 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:43185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 21:09:15.289930 19725 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.37.61:43185: connect: Connection refused (error 111)
I20260810 21:09:15.290467 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.290337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:43185 (local address 127.0.0.1:41300)
0810 21:09:15.290394 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.290432 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:43185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 21:09:15.290617 19806 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.61:43185: Network error: Client connection negotiation failed: client connection to 127.15.37.61:43185: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.61.keytab.
Entry for principal kudu/127.15.37.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.61.keytab.
I20260810 21:09:15.303568 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.61:43185
--webserver_interface=127.15.37.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.61.keytab
--principal=kudu/127.15.37.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:38237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:40069,127.15.37.61:43185,127.15.37.60:34401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:09:15.339912 19806 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } attempt: 1
I20260810 21:09:15.340656 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.340432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:43185 (local address 127.0.0.1:41302)
0810 21:09:15.340556 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.340612 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:43185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260810 21:09:15.341096 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.340991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:43185 (local address 127.0.0.1:41310)
0810 21:09:15.341043 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.341075 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:43185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260810 21:09:15.341233 19806 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.61:43185: Network error: Client connection negotiation failed: client connection to 127.15.37.61:43185: connect: Connection refused (error 111)
W20260810 21:09:15.399318 19818 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 21:09:15.399588 19818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:09:15.399609 19818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:09:15.399631 19818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:09:15.401031 19818 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:09:15.401094 19818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:09:15.401110 19818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:09:15.401124 19818 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:09:15.401135 19818 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:09:15.402920 19818 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:38237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:40069,127.15.37.61:43185,127.15.37.60:34401
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.61.keytab
--principal=kudu/127.15.37.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.61:43185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.37.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:09:15.403268 19818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:09:15.403553 19818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:09:15.409612 19827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:15.409782 19829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:15.409560 19806 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } attempt: 2
W20260810 21:09:15.409775 19826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:15.410252 19818 server_base.cc:1034] running on GCE node
I20260810 21:09:15.410338 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.410199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:43185 (local address 127.0.0.1:41322)
0810 21:09:15.410251 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.410287 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:43185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260810 21:09:15.410566 19818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:09:15.410699 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.410591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:43185 (local address 127.0.0.1:41332)
0810 21:09:15.410642 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.410671 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.61:43185: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 21:09:15.410806 19806 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.61:43185: Network error: Client connection negotiation failed: client connection to 127.15.37.61:43185: connect: Connection refused (error 111)
I20260810 21:09:15.411021 19818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:09:15.412232 19818 hybrid_clock.cc:648] HybridClock initialized: now 1786396155412203 us; error 42 us; skew 500 ppm
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:09:15.415343 19818 init.cc:377] Logged in from keytab as kudu/127.15.37.61@KRBTEST.COM (short username kudu)
I20260810 21:09:15.415904 19818 webserver.cc:460] Webserver started at http://127.15.37.61:46371/ using document root <none> and password file <none>
I20260810 21:09:15.416131 19818 fs_manager.cc:359] Metadata directory not provided
I20260810 21:09:15.416175 19818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:09:15.416286 19818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:09:15.417507 19818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/data/instance:
uuid: "f4110469a90644f7ac67fc16c7c4b7c9"
format_stamp: "Formatted at 2026-08-10 21:09:15 on dist-test-slave-jq4t"
server_key: "97f2c725eba302972467f799b56159d5"
server_key_iv: "7ab87c58bdd08705ad6e403d63a671f2"
server_key_version: "encryptionkey@0"
I20260810 21:09:15.417857 19818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/wal/instance:
uuid: "f4110469a90644f7ac67fc16c7c4b7c9"
format_stamp: "Formatted at 2026-08-10 21:09:15 on dist-test-slave-jq4t"
server_key: "97f2c725eba302972467f799b56159d5"
server_key_iv: "7ab87c58bdd08705ad6e403d63a671f2"
server_key_version: "encryptionkey@0"
I20260810 21:09:15.419337 19818 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 21:09:15.420387 19839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:09:15.420601 19818 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 21:09:15.420709 19818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/wal
uuid: "f4110469a90644f7ac67fc16c7c4b7c9"
format_stamp: "Formatted at 2026-08-10 21:09:15 on dist-test-slave-jq4t"
server_key: "97f2c725eba302972467f799b56159d5"
server_key_iv: "7ab87c58bdd08705ad6e403d63a671f2"
server_key_version: "encryptionkey@0"
I20260810 21:09:15.420785 19818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:09:15.430954 19818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:09:15.433692 19818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:09:15.433828 19818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:09:15.438326 19818 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.61:43185
I20260810 21:09:15.438369 19929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.61:43185 every 8 connection(s)
I20260810 21:09:15.438791 19818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/data/info.pb
I20260810 21:09:15.439997 19930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:09:15.440768 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 19818
I20260810 21:09:15.440858 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-1/wal/instance
I20260810 21:09:15.441080 15508 external_mini_cluster.cc:1428] Setting key bdd8ed0fc18928bd0e4dddb39f4b73ff
I20260810 21:09:15.442023 19930 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.61@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.15.37.60@KRBTEST.COM; defaulting to no policy
I20260810 21:09:15.452715 19814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.442921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35344 (local address 127.15.37.62:40069)
0810 21:09:15.442978 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.442981 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.443256 (+ 275us) server_negotiation.cc:407] Connection header received
0810 21:09:15.443768 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.443770 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.443785 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.443876 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.444834 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.445368 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.446476 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.446709 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.446791 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.449382 (+ 2591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.449384 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.449384 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.449392 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.450941 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.451505 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.451506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.451507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.451574 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.451847 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.451848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.451849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.451990 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.452071 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.452459 (+ 388us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.452598 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.15.37.60@KRBTEST.COM" created.
I20260810 21:09:15.452986 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.442891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:40069 (local address 127.0.0.1:35344)
0810 21:09:15.443105 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.443150 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:15.443658 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:15.443953 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:15.443956 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:15.444388 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:15.444706 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.444713 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.445495 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.445497 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.446355 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.446359 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.446839 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.446841 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.446981 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.447642 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:15.447651 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:15.449243 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:15.451079 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.451089 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.451092 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.451411 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.451644 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.451645 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.451646 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.451774 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.452060 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:15.452068 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:15.452313 (+ 245us) client_negotiation.cc:769] Sending connection context
0810 21:09:15.452437 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 21:09:15.452711 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":120,"threads_started":1}
I20260810 21:09:15.453677 19930 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.61@KRBTEST.COM for kudu/127.15.37.61@KRBTEST.COM
I20260810 21:09:15.462968 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.454012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:43185 (local address 127.0.0.1:41336)
0810 21:09:15.454240 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.454252 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:15.454305 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:15.454452 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:15.454453 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:15.454614 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:15.454672 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.454674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.455853 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.455854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.456386 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.456387 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.457144 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.457145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.457217 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.457756 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:15.457761 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:15.459352 (+ 1591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:15.461605 (+ 2253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.461607 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.461608 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.461848 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.462135 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.462136 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.462137 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.462211 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.462548 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:15.462549 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:15.462613 (+ 64us) client_negotiation.cc:769] Sending connection context
0810 21:09:15.462705 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 21:09:15.462841 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211}
I20260810 21:09:15.463227 19939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.454064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41336 (local address 127.15.37.61:43185)
0810 21:09:15.454255 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.454260 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.454302 (+ 42us) server_negotiation.cc:407] Connection header received
0810 21:09:15.454363 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.454366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.454379 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.454450 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.454750 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.455734 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.456511 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.457033 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.457118 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.459453 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.459467 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.459468 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.459475 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.461492 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.461975 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.461979 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.461979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.462045 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.462286 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.462287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.462287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.462467 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.462536 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.462773 (+ 237us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.462913 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":162,"thread_start_us":124,"threads_started":1}
I20260810 21:09:15.463907 19930 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:09:15.464344 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.464222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34401 (local address 127.0.0.1:60942)
0810 21:09:15.464272 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.464322 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 21:09:15.464541 19841 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
I20260810 21:09:15.465049 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.464961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34401 (local address 127.0.0.1:60946)
0810 21:09:15.465005 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.465031 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 21:09:15.465219 19930 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:34401: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.15.37.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.60.keytab.
Entry for principal kudu/127.15.37.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.60.keytab.
I20260810 21:09:15.472791 15508 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskEugCJs/build/release/bin/kudu
/tmp/dist-test-taskEugCJs/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.60:34401
--webserver_interface=127.15.37.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.60.keytab
--principal=kudu/127.15.37.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.15.37.20:38237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.37.62:40069,127.15.37.61:43185,127.15.37.60:34401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 21:09:15.501998 19806 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } attempt: 3
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for kudu/127.15.37.61@KRBTEST.COM
I20260810 21:09:15.510088 19939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.502573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41350 (local address 127.15.37.61:43185)
0810 21:09:15.502659 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.502662 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.502675 (+ 13us) server_negotiation.cc:407] Connection header received
0810 21:09:15.502710 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.502711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.502727 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.502798 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.503173 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.503703 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.504464 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.504728 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.504814 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.507151 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.507153 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.507154 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.507163 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.508817 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.509223 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.509225 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.509225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.509288 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.509507 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.509508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.509508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.509639 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.509718 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.509895 (+ 177us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.509980 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 21:09:15.510088 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.502482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:43185 (local address 127.0.0.1:41350)
0810 21:09:15.502552 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.502566 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:15.502647 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:15.502805 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:15.502806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:15.503006 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:15.503078 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.503080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.503798 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.503799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.504362 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.504364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.504812 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.504813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.504908 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.505440 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:15.505445 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:15.507031 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:15.508933 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.508935 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.508936 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.509129 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.509359 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.509360 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.509360 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.509432 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.509708 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:15.509709 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:15.509765 (+ 56us) client_negotiation.cc:769] Sending connection context
0810 21:09:15.509850 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 21:09:15.509980 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 21:09:15.510555 19806 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:09:15.510962 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.510844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34401 (local address 127.0.0.1:60962)
0810 21:09:15.510903 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.510933 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260810 21:09:15.511389 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.511303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34401 (local address 127.0.0.1:60972)
0810 21:09:15.511346 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.511372 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 21:09:15.511502 19806 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:34401: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
I20260810 21:09:15.514467 19930 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } attempt: 1
I20260810 21:09:15.514957 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.514792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34401 (local address 127.0.0.1:60978)
0810 21:09:15.514871 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.514929 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260810 21:09:15.515340 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.515237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34401 (local address 127.0.0.1:60994)
0810 21:09:15.515286 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.515319 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 21:09:15.515439 19930 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:34401: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
I20260810 21:09:15.542675 19806 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } attempt: 1
I20260810 21:09:15.543241 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.543094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34401 (local address 127.0.0.1:60998)
0810 21:09:15.543166 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.543210 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 21:09:15.543650 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.543534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34401 (local address 127.0.0.1:32780)
0810 21:09:15.543598 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.543624 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 21:09:15.543741 19806 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:34401: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
W20260810 21:09:15.564870 19943 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 21:09:15.565129 19943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 21:09:15.565148 19943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 21:09:15.565172 19943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 21:09:15.566452 19943 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 21:09:15.566512 19943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 21:09:15.566527 19943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 21:09:15.566540 19943 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 21:09:15.566553 19943 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 21:09:15.568210 19943 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.37.20:38237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.15.37.62:40069,127.15.37.61:43185,127.15.37.60:34401
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/krb5kdc/kudu_127.15.37.60.keytab
--principal=kudu/127.15.37.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.37.60:34401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.37.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19943
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 20:11:33 UTC on ccycloud.quasar-zccrtj.root.comops.site
build id 4579040
I20260810 21:09:15.568562 19943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 21:09:15.568846 19943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 21:09:15.574599 19953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 21:09:15.574582 19955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:15.574678 19943 server_base.cc:1034] running on GCE node
W20260810 21:09:15.574582 19952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 21:09:15.575198 19943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 21:09:15.575591 19943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 21:09:15.576764 19943 hybrid_clock.cc:648] HybridClock initialized: now 1786396155576742 us; error 43 us; skew 500 ppm
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 21:09:15.579810 19943 init.cc:377] Logged in from keytab as kudu/127.15.37.60@KRBTEST.COM (short username kudu)
I20260810 21:09:15.580344 19943 webserver.cc:460] Webserver started at http://127.15.37.60:35059/ using document root <none> and password file <none>
I20260810 21:09:15.580626 19943 fs_manager.cc:359] Metadata directory not provided
I20260810 21:09:15.580677 19943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 21:09:15.580781 19943 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 21:09:15.581911 19943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/data/instance:
uuid: "2d5f4f2fbbfe463eb974ad80e19a693b"
format_stamp: "Formatted at 2026-08-10 21:09:15 on dist-test-slave-jq4t"
server_key: "4b1c16c0135f49376067858a84060635"
server_key_iv: "6b9c203f5ab19b1d7d22f6c65474bd19"
server_key_version: "encryptionkey@0"
I20260810 21:09:15.582240 19943 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/wal/instance:
uuid: "2d5f4f2fbbfe463eb974ad80e19a693b"
format_stamp: "Formatted at 2026-08-10 21:09:15 on dist-test-slave-jq4t"
server_key: "4b1c16c0135f49376067858a84060635"
server_key_iv: "6b9c203f5ab19b1d7d22f6c65474bd19"
server_key_version: "encryptionkey@0"
I20260810 21:09:15.583592 19930 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } attempt: 2
I20260810 21:09:15.583670 19943 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 21:09:15.584049 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.583913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34401 (local address 127.0.0.1:32782)
0810 21:09:15.583979 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.584021 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 21:09:15.584435 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.584283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34401 (local address 127.0.0.1:32786)
0810 21:09:15.584342 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.584377 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260810 21:09:15.584578 19930 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.15.37.60:34401: Network error: Client connection negotiation failed: client connection to 127.15.37.60:34401: connect: Connection refused (error 111)
I20260810 21:09:15.584678 19967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 21:09:15.584913 19943 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 21:09:15.585021 19943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/data,/tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/wal
uuid: "2d5f4f2fbbfe463eb974ad80e19a693b"
format_stamp: "Formatted at 2026-08-10 21:09:15 on dist-test-slave-jq4t"
server_key: "4b1c16c0135f49376067858a84060635"
server_key_iv: "6b9c203f5ab19b1d7d22f6c65474bd19"
server_key_version: "encryptionkey@0"
I20260810 21:09:15.585103 19943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 21:09:15.593425 19943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 21:09:15.595806 19943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 21:09:15.595974 19943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 21:09:15.600859 19943 rpc_server.cc:307] RPC server started. Bound to: 127.15.37.60:34401
I20260810 21:09:15.600901 20047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.15.37.60:34401 every 8 connection(s)
I20260810 21:09:15.601332 19943 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/data/info.pb
I20260810 21:09:15.602568 20048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 21:09:15.604372 20048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } has no permanent_uuid. Determining permanent_uuid...
I20260810 21:09:15.609519 15508 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskEugCJs/build/release/bin/kudu as pid 19943
I20260810 21:09:15.609674 15508 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskEugCJs/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786395855004795-15508-0/minicluster-data/master-2/wal/instance
I20260810 21:09:15.609910 15508 external_mini_cluster.cc:1428] Setting key 61363cea3975631d4a4dafa0ae2c2c1f
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.60@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:09:15.615638 19814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.605394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35356 (local address 127.15.37.62:40069)
0810 21:09:15.605516 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.605519 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.605737 (+ 218us) server_negotiation.cc:407] Connection header received
0810 21:09:15.606392 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.606394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.606407 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.606469 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.607170 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.607676 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.608828 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.609037 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.609130 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.611975 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.611977 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.611978 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.611987 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.613855 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.614422 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.614423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.614423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.614494 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.614812 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.614814 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.614814 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.614974 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.615034 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.615411 (+ 377us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.615517 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260810 21:09:15.615738 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.605290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.62:40069 (local address 127.0.0.1:35356)
0810 21:09:15.605602 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.605644 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:15.606270 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:15.606554 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:15.606558 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:15.606846 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:15.607068 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.607072 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.607793 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.607795 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.608721 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.608724 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.609163 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.609164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.609294 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.609946 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:15.609956 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:15.611870 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:15.613939 (+ 2069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.613964 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.613967 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.614323 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.614571 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.614572 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.614572 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.614731 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.615050 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:15.615057 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:15.615249 (+ 192us) client_negotiation.cc:769] Sending connection context
0810 21:09:15.615346 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 21:09:15.615491 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":143,"threads_started":1}
I20260810 21:09:15.616572 20048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.60@KRBTEST.COM
I20260810 21:09:15.618889 19806 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } attempt: 2
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.60@KRBTEST.COM for kudu/127.15.37.61@KRBTEST.COM
I20260810 21:09:15.622646 20057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.610369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32796 (local address 127.15.37.60:34401)
0810 21:09:15.610553 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.610558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.610580 (+ 22us) server_negotiation.cc:407] Connection header received
0810 21:09:15.610676 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.610679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.610704 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.610795 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.611614 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.612679 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.614051 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.614577 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.614651 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.617768 (+ 3117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.617778 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.617778 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.617786 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.620309 (+ 2523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.620798 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.620802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.620802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.620865 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.621127 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.621128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.621129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.621345 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.621526 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.622400 (+ 874us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.622480 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":90,"threads_started":1}
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.62@KRBTEST.COM for kudu/127.15.37.60@KRBTEST.COM
I20260810 21:09:15.626080 19939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.616994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41364 (local address 127.15.37.61:43185)
0810 21:09:15.617064 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.617066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.617077 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:09:15.617113 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.617114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.617123 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.617173 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.617505 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.618155 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.619347 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.619850 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.619914 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.622971 (+ 3057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.622973 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.622973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.622981 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.624700 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.625146 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.625148 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.625148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.625220 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.625451 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.625452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.625452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.625598 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.625664 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.625869 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.625961 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 21:09:15.626582 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.616925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.61:43185 (local address 127.0.0.1:41364)
0810 21:09:15.617004 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.617015 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:15.617055 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:15.617177 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:15.617178 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:15.617338 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:15.617419 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.617421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.618259 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.618261 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.619123 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.619135 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.620001 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.620002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.620116 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.620843 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:15.620849 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:15.622869 (+ 2020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:15.624814 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.624815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.624815 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.625053 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.625299 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.625300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.625301 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.625369 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.625697 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:15.625698 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:15.625750 (+ 52us) client_negotiation.cc:769] Sending connection context
0810 21:09:15.626213 (+ 463us) client_negotiation.cc:240] Negotiation successful
0810 21:09:15.626331 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 21:09:15.627396 20048 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.62@KRBTEST.COM
I20260810 21:09:15.629377 19810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.619223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34401 (local address 127.0.0.1:32808)
0810 21:09:15.619280 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.619292 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:15.619335 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:15.619811 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:15.619812 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:15.619972 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:15.620038 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.620040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.621026 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.621027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.621786 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.621790 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.622283 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.622284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.622360 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.623302 (+ 942us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:15.623309 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:15.625092 (+ 1783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:15.628058 (+ 2966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.628059 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.628060 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.628311 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.628578 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.628579 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.628580 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.628669 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.629008 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:15.629010 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:15.629068 (+ 58us) client_negotiation.cc:769] Sending connection context
0810 21:09:15.629148 (+ 80us) client_negotiation.cc:240] Negotiation successful
0810 21:09:15.629256 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 21:09:15.629882 20058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.619262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32808 (local address 127.15.37.60:34401)
0810 21:09:15.619529 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.619532 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.619543 (+ 11us) server_negotiation.cc:407] Connection header received
0810 21:09:15.619572 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.619573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.619594 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.619806 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.620139 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.620931 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.621898 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.622193 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.622278 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.625182 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.625183 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.625183 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.625190 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.627928 (+ 2738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.628404 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.628406 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.628406 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.628520 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.628738 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.628739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.628740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.628923 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.629005 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.629613 (+ 608us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.629702 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":129,"threads_started":1}
I20260810 21:09:15.632333 19806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2: Bootstrap starting.
I20260810 21:09:15.632853 19814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.624046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35368 (local address 127.15.37.62:40069)
0810 21:09:15.624091 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.624093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.624102 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:09:15.624127 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.624128 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.624140 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.624203 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.624880 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.625586 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.626603 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.626909 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.626993 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.629883 (+ 2890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.629885 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.629885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.629894 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.631475 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.631954 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.631956 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.631956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.632028 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.632243 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.632245 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.632245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.632373 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.632581 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.632658 (+ 77us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.632752 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 21:09:15.633262 19806 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2: Neither blocks nor log segments found. Creating new log.
I20260810 21:09:15.633664 19806 log.cc:824] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2: Log is configured to *not* fsync() on all Append() calls
I20260810 21:09:15.634528 19806 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2: No bootstrap required, opened a new log
I20260810 21:09:15.636108 19806 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } }
I20260810 21:09:15.636272 19806 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc6304bdc98d4ebf8d703779e1a117e2, State: Initialized, Role: FOLLOWER
I20260810 21:09:15.636371 19806 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } }
I20260810 21:09:15.636731 20061 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } } }
I20260810 21:09:15.636828 19806 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:09:15.636917 20061 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [sys.catalog]: This master's current role is: FOLLOWER
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.60@KRBTEST.COM for kudu/127.15.37.60@KRBTEST.COM
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.37.61@KRBTEST.COM
W20260810 21:09:15.639109 20076 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:09:15.639196 20076 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:09:15.642922 20052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.627726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34401 (local address 127.0.0.1:32812)
0810 21:09:15.627759 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.627769 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:15.627810 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:15.627965 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:15.627966 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:15.628144 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:15.628186 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.628188 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.629173 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.629174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.629867 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.629870 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.630386 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.630388 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.630453 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.636565 (+ 6112us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:15.636573 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:15.639069 (+ 2496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:15.641778 (+ 2709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.641779 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.641780 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.641995 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.642202 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.642202 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.642202 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.642251 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.642599 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:15.642601 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:15.642647 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 21:09:15.642703 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 21:09:15.642822 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260810 21:09:15.643177 19939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.633590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41374 (local address 127.15.37.61:43185)
0810 21:09:15.633661 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.633663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.633671 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:09:15.633696 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.633697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.633707 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.633776 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.634392 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.634955 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.635673 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.635883 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.635967 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.639263 (+ 3296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.639264 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.639264 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.639273 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.641443 (+ 2170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.641964 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.641966 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.641967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.642044 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.642261 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.642262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.642262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.642413 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.642565 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.642994 (+ 429us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.643078 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 21:09:15.643352 20057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.627764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32812 (local address 127.15.37.60:34401)
0810 21:09:15.627874 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.627875 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.627880 (+ 5us) server_negotiation.cc:407] Connection header received
0810 21:09:15.627893 (+ 13us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.627893 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.627901 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.627962 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.628281 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.629085 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.629947 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.630276 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.630355 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.639186 (+ 8831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.639188 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.639188 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.639197 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.641674 (+ 2477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.642089 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.642090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.642091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.642142 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.642305 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.642306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.642306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.642507 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.642575 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.643182 (+ 607us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.643274 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260810 21:09:15.640254 19698 master_runner.cc:186] Error getting master registration for 127.15.37.61:43185: OK, instance_id { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" instance_seqno: 1786396155437000 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 21:09:15.643813 19698 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 21:09:15.645423 15508 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 21:09:15.645792 20048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b: Bootstrap starting.
I20260810 21:09:15.646447 19757 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "bc6304bdc98d4ebf8d703779e1a117e2"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35368
I20260810 21:09:15.646628 20048 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b: Neither blocks nor log segments found. Creating new log.
I20260810 21:09:15.646647 19757 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 21:09:15.646713 19757 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:09:15.646983 20048 log.cc:824] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b: Log is configured to *not* fsync() on all Append() calls
I20260810 21:09:15.647717 19757 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } }
I20260810 21:09:15.648023 20048 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b: No bootstrap required, opened a new log
I20260810 21:09:15.648034 19757 leader_election.cc:288] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [CANDIDATE]: Term 1 election: Requested vote from peers f4110469a90644f7ac67fc16c7c4b7c9 (127.15.37.61:43185), 2d5f4f2fbbfe463eb974ad80e19a693b (127.15.37.60:34401)
I20260810 21:09:15.651481 20048 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } }
I20260810 21:09:15.651675 20048 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d5f4f2fbbfe463eb974ad80e19a693b, State: Initialized, Role: FOLLOWER
I20260810 21:09:15.651760 20048 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } }
I20260810 21:09:15.652117 20048 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:09:15.652081 20095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } } }
I20260810 21:09:15.652266 20095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:09:15.652328 20013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b"
I20260810 21:09:15.652456 20013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:09:15.654071 20013 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc6304bdc98d4ebf8d703779e1a117e2 in term 1.
I20260810 21:09:15.654486 19721 leader_election.cc:302] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d5f4f2fbbfe463eb974ad80e19a693b, bc6304bdc98d4ebf8d703779e1a117e2; no voters:
I20260810 21:09:15.654721 20061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 21:09:15.654945 20061 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [term 1 LEADER]: Becoming Leader. State: Replica: bc6304bdc98d4ebf8d703779e1a117e2, State: Running, Role: LEADER
I20260810 21:09:15.655066 20061 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } }
I20260810 21:09:15.656729 20118 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc6304bdc98d4ebf8d703779e1a117e2. Latest consensus state: current_term: 1 leader_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } } }
I20260810 21:09:15.657202 20118 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [sys.catalog]: This master's current role is: LEADER
W20260810 21:09:15.657985 20117 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:09:15.658048 20117 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:09:15.657224 19943 master_runner.cc:186] Error getting master registration for 127.15.37.61:43185: OK, instance_id { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" instance_seqno: 1786396155437000 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 21:09:15.660624 19943 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 21:09:15.666404 19814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.649521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35380 (local address 127.15.37.62:40069)
0810 21:09:15.649583 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.649585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.649835 (+ 250us) server_negotiation.cc:407] Connection header received
0810 21:09:15.649998 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.649999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.650025 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.650057 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.651447 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.652216 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.656032 (+ 3816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.656360 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.656403 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.662013 (+ 5610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.662015 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.662015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.662025 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.665018 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.665455 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.665457 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.665457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.665519 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.665724 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.665725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.665725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.665891 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.665970 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.666196 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.666298 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 21:09:15.670161 19939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.649362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41388 (local address 127.15.37.61:43185)
0810 21:09:15.649411 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.649414 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.654688 (+ 5274us) server_negotiation.cc:407] Connection header received
0810 21:09:15.654809 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.654810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.654825 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.654858 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.660644 (+ 5786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.661388 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.662504 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.663453 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.663548 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.666020 (+ 2472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.666022 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.666023 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.666033 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.668743 (+ 2710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.669202 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.669203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.669204 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.669271 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.669475 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.669476 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.669477 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.669618 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.669701 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.669956 (+ 255us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.670051 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 21:09:15.672719 20120 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 21:09:15.673041 20120 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 21:09:15.675524 20013 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b [term 1 FOLLOWER]: Refusing update from remote peer bc6304bdc98d4ebf8d703779e1a117e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:09:15.675724 19930 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } attempt: 3
I20260810 21:09:15.675943 20118 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:09:15.677984 20095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc6304bdc98d4ebf8d703779e1a117e2. Latest consensus state: current_term: 1 leader_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } } }
I20260810 21:09:15.678099 20095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b [sys.catalog]: This master's current role is: FOLLOWER
Aug 10 21:09:15 dist-test-slave-jq4t krb5kdc[19676](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786396155, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.37.61@KRBTEST.COM for kudu/127.15.37.60@KRBTEST.COM
I20260810 21:09:15.683880 20057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.649976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32828 (local address 127.15.37.60:34401)
0810 21:09:15.650032 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.650034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.662642 (+ 12608us) server_negotiation.cc:407] Connection header received
0810 21:09:15.663959 (+ 1317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.663962 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.663976 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.664012 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.668925 (+ 4913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.669703 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.672018 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.672350 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.672434 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.677232 (+ 4798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.677234 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.677234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.677243 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.680790 (+ 3547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.682242 (+ 1452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.682244 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.682244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.682313 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.682532 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.682532 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.682533 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.682676 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.682764 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.683673 (+ 909us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.683768 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 21:09:15.686702 20058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.676511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32836 (local address 127.15.37.60:34401)
0810 21:09:15.676635 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.676637 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.676646 (+ 9us) server_negotiation.cc:407] Connection header received
0810 21:09:15.676669 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.676670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.676682 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.676737 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.677176 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.677998 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.679903 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.680270 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.680346 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.683193 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 21:09:15.683195 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 21:09:15.683195 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 21:09:15.683202 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 21:09:15.685245 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.685854 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.685855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.685855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.685917 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 21:09:15.686129 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 21:09:15.686129 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 21:09:15.686130 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 21:09:15.686275 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 21:09:15.686345 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:15.686507 (+ 162us) server_negotiation.cc:299] Negotiation successful
0810 21:09:15.686604 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260810 21:09:15.686713 19936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:15.676010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.37.60:34401 (local address 127.0.0.1:32836)
0810 21:09:15.676222 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0810 21:09:15.676244 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 21:09:15.676298 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 21:09:15.676794 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 21:09:15.676796 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 21:09:15.676997 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0810 21:09:15.677052 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.677055 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.678788 (+ 1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.678789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.679790 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 21:09:15.679793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 21:09:15.680879 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 21:09:15.680880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 21:09:15.680959 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:15.681425 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 21:09:15.681431 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 21:09:15.683093 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 21:09:15.685344 (+ 2251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.685346 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.685346 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.685614 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.685989 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 21:09:15.685990 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 21:09:15.685990 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 21:09:15.686069 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 21:09:15.686348 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 21:09:15.686349 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 21:09:15.686406 (+ 57us) client_negotiation.cc:769] Sending connection context
0810 21:09:15.686482 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 21:09:15.686606 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185}
I20260810 21:09:15.689854 19930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9: Bootstrap starting.
I20260810 21:09:15.690758 19930 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9: Neither blocks nor log segments found. Creating new log.
I20260810 21:09:15.691226 19930 log.cc:824] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9: Log is configured to *not* fsync() on all Append() calls
I20260810 21:09:15.692514 19930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9: No bootstrap required, opened a new log
I20260810 21:09:15.694797 19930 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } }
I20260810 21:09:15.695099 19930 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4110469a90644f7ac67fc16c7c4b7c9, State: Initialized, Role: FOLLOWER
I20260810 21:09:15.695246 19930 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } }
I20260810 21:09:15.695694 19930 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 21:09:15.695792 19871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 21:09:15.696971 19871 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9 [term 1 FOLLOWER]: Refusing update from remote peer bc6304bdc98d4ebf8d703779e1a117e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 21:09:15.697419 20118 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 21:09:15.697775 19872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f4110469a90644f7ac67fc16c7c4b7c9"
I20260810 21:09:15.698778 19872 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc6304bdc98d4ebf8d703779e1a117e2 in term 1.
I20260810 21:09:15.699728 20124 mvcc.cc:205] Tried to move back new op lower bound from 7317078653642924032 to 7317078653564080128. Current Snapshot: MvccSnapshot[applied={T|T < 7317078653642924032}]
I20260810 21:09:15.700107 20118 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } } }
I20260810 21:09:15.700204 20118 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:15.700417 20123 mvcc.cc:205] Tried to move back new op lower bound from 7317078653642924032 to 7317078653564080128. Current Snapshot: MvccSnapshot[applied={T|T < 7317078653642924032}]
W20260810 21:09:15.700825 20151 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 21:09:15.700887 20151 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 21:09:15.701005 20128 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } } }
I20260810 21:09:15.701083 20128 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:09:15.701133 20128 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc6304bdc98d4ebf8d703779e1a117e2. Latest consensus state: current_term: 1 leader_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } } }
I20260810 21:09:15.701109 20095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } } }
I20260810 21:09:15.701179 20128 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:09:15.701195 20095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:09:15.701874 20061 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } } }
I20260810 21:09:15.701964 20061 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2 [sys.catalog]: This master's current role is: LEADER
I20260810 21:09:15.702275 20128 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc6304bdc98d4ebf8d703779e1a117e2" member_type: VOTER last_known_addr { host: "127.15.37.62" port: 40069 } } peers { permanent_uuid: "f4110469a90644f7ac67fc16c7c4b7c9" member_type: VOTER last_known_addr { host: "127.15.37.61" port: 43185 } } peers { permanent_uuid: "2d5f4f2fbbfe463eb974ad80e19a693b" member_type: VOTER last_known_addr { host: "127.15.37.60" port: 34401 } } }
I20260810 21:09:15.702358 20128 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 21:09:15.705016 20157 mvcc.cc:205] Tried to move back new op lower bound from 7317078653642924032 to 7317078653564080128. Current Snapshot: MvccSnapshot[applied={T|T < 7317078653642924032}]
I20260810 21:09:15.706063 20120 catalog_manager.cc:1347] Generated new cluster ID: 1f5916cc3fc2489cb0133ff942aa7eae
I20260810 21:09:15.706128 20120 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 21:09:15.723860 20120 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 21:09:15.724819 20120 catalog_manager.cc:1504] Loading token signing keys...
I20260810 21:09:15.738189 20120 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc6304bdc98d4ebf8d703779e1a117e2: Generated new TSK 0
I20260810 21:09:15.738528 20120 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 21:09:15.769472 19814 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:15.768232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35384 (local address 127.15.37.62:40069)
0810 21:09:15.768286 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.768288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.768674 (+ 386us) server_negotiation.cc:407] Connection header received
0810 21:09:15.768794 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.768796 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.768810 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.768845 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.769391 (+ 546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35384: BlockingRecv error: recv got EOF from 127.0.0.1:35384 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260810 21:09:15.770793 20058 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:15.769945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32840 (local address 127.15.37.60:34401)
0810 21:09:15.769992 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.769994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.770257 (+ 263us) server_negotiation.cc:407] Connection header received
0810 21:09:15.770289 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.770290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.770301 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.770363 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.770730 (+ 367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32840: BlockingRecv error: recv got EOF from 127.0.0.1:32840 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260810 21:09:15.771701 19939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:15.770062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41398 (local address 127.15.37.61:43185)
0810 21:09:15.770106 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.770108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.771192 (+ 1084us) server_negotiation.cc:407] Connection header received
0810 21:09:15.771222 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.771223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.771235 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.771279 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.771638 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41398: BlockingRecv error: recv got EOF from 127.0.0.1:41398 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260810 21:09:15.774220 19939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:15.773421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41404 (local address 127.15.37.61:43185)
0810 21:09:15.773459 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.773461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.773659 (+ 198us) server_negotiation.cc:407] Connection header received
0810 21:09:15.773772 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.773773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.773793 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.773825 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.774170 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41404: BlockingRecv error: recv got EOF from 127.0.0.1:41404 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 21:09:15.777642 19939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:15.776772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41420 (local address 127.15.37.61:43185)
0810 21:09:15.776811 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.776813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.777057 (+ 244us) server_negotiation.cc:407] Connection header received
0810 21:09:15.777162 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.777163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.777175 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.777207 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.777589 (+ 382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41420: BlockingRecv error: recv got EOF from 127.0.0.1:41420 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 21:09:15.782235 19939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:15.781273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41430 (local address 127.15.37.61:43185)
0810 21:09:15.781330 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.781333 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.781627 (+ 294us) server_negotiation.cc:407] Connection header received
0810 21:09:15.781740 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.781741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.781754 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.781786 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.782180 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41430: BlockingRecv error: recv got EOF from 127.0.0.1:41430 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 21:09:15.788812 19939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:15.787659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41438 (local address 127.15.37.61:43185)
0810 21:09:15.787704 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.787706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.788054 (+ 348us) server_negotiation.cc:407] Connection header received
0810 21:09:15.788181 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.788183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.788197 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.788231 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.788750 (+ 519us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41438: BlockingRecv error: recv got EOF from 127.0.0.1:41438 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260810 21:09:15.799419 19939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:15.798327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41454 (local address 127.15.37.61:43185)
0810 21:09:15.798377 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.798379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.798722 (+ 343us) server_negotiation.cc:407] Connection header received
0810 21:09:15.798839 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.798840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.798854 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.798887 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.799352 (+ 465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41454: BlockingRecv error: recv got EOF from 127.0.0.1:41454 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260810 21:09:15.818358 19939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:15.817004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41466 (local address 127.15.37.61:43185)
0810 21:09:15.817057 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.817059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.817622 (+ 563us) server_negotiation.cc:407] Connection header received
0810 21:09:15.817755 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.817757 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.817772 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.817807 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.818289 (+ 482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41466: BlockingRecv error: recv got EOF from 127.0.0.1:41466 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260810 21:09:15.852852 19939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:15.851905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41482 (local address 127.15.37.61:43185)
0810 21:09:15.851961 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.851963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.852135 (+ 172us) server_negotiation.cc:407] Connection header received
0810 21:09:15.852252 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.852252 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.852266 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.852337 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.852780 (+ 443us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41482: BlockingRecv error: recv got EOF from 127.0.0.1:41482 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260810 21:09:15.918793 19939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:15.918094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41498 (local address 127.15.37.61:43185)
0810 21:09:15.918169 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:15.918172 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:15.918287 (+ 115us) server_negotiation.cc:407] Connection header received
0810 21:09:15.918337 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:15.918338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:15.918349 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:15.918410 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:15.918741 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41498: BlockingRecv error: recv got EOF from 127.0.0.1:41498 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260810 21:09:16.049247 19939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:16.048341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41500 (local address 127.15.37.61:43185)
0810 21:09:16.048563 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:16.048566 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:16.048586 (+ 20us) server_negotiation.cc:407] Connection header received
0810 21:09:16.048618 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:16.048619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:16.048631 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:16.048693 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:16.049157 (+ 464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41500: BlockingRecv error: recv got EOF from 127.0.0.1:41500 (error 108)
Metrics: {"server-negotiator.queue_time_us":127}
W20260810 21:09:16.307612 19939 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 21:09:16.306779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41512 (local address 127.15.37.61:43185)
0810 21:09:16.306869 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:16.306871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:16.306883 (+ 12us) server_negotiation.cc:407] Connection header received
0810 21:09:16.306965 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:16.306966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:16.306983 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:16.307053 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 21:09:16.307552 (+ 499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41512: BlockingRecv error: recv got EOF from 127.0.0.1:41512 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260810 21:09:16.658646 20117 catalog_manager.cc:1259] Loaded cluster ID: 1f5916cc3fc2489cb0133ff942aa7eae
I20260810 21:09:16.658785 20117 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b: loading cluster ID for follower catalog manager: success
I20260810 21:09:16.659749 20117 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b: acquiring CA information for follower catalog manager: success
I20260810 21:09:16.660121 20117 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2d5f4f2fbbfe463eb974ad80e19a693b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 21:09:16.701442 20151 catalog_manager.cc:1259] Loaded cluster ID: 1f5916cc3fc2489cb0133ff942aa7eae
I20260810 21:09:16.701558 20151 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9: loading cluster ID for follower catalog manager: success
I20260810 21:09:16.702411 20151 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9: acquiring CA information for follower catalog manager: success
I20260810 21:09:16.702768 20151 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f4110469a90644f7ac67fc16c7c4b7c9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 21:09:16.823935 20264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:16.821059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41528 (local address 127.15.37.61:43185)
0810 21:09:16.821210 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:16.821212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:16.821248 (+ 36us) server_negotiation.cc:407] Connection header received
0810 21:09:16.821325 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:16.821326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:16.821398 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:16.821476 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:09:16.821618 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:16.822343 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:16.823175 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:16.823369 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:16.823424 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:16.823614 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:09:16.823736 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:09:16.823797 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:16.823834 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 21:09:16.823856 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
I20260810 21:09:16.828817 20273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:16.826230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32842 (local address 127.15.37.60:34401)
0810 21:09:16.826351 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:16.826353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:16.826403 (+ 50us) server_negotiation.cc:407] Connection header received
0810 21:09:16.826479 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:16.826479 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:16.826520 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:16.826592 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:09:16.826683 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:16.827171 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:16.827878 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:16.828170 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:16.828227 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:16.828365 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:09:16.828541 (+ 176us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:09:16.828604 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:16.828661 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 21:09:16.828680 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":67,"threads_started":1}
I20260810 21:09:16.834403 20264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:16.831017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41530 (local address 127.15.37.61:43185)
0810 21:09:16.831067 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:16.831069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:16.831200 (+ 131us) server_negotiation.cc:407] Connection header received
0810 21:09:16.831257 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:16.831258 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:16.831269 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:16.831313 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:09:16.831458 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:16.832261 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:16.833645 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:16.833858 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:16.833939 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:16.834092 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:09:16.834132 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:09:16.834194 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:16.834265 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 21:09:16.834295 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 21:09:16.834515 20273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:16.831021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32850 (local address 127.15.37.60:34401)
0810 21:09:16.831064 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:16.831066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:16.831524 (+ 458us) server_negotiation.cc:407] Connection header received
0810 21:09:16.831551 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:16.831552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:16.831564 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:16.831612 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:09:16.831691 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:16.832385 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:16.833601 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:16.833911 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:16.833981 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:16.834160 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:09:16.834200 (+ 40us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:09:16.834249 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:16.834410 (+ 161us) server_negotiation.cc:299] Negotiation successful
0810 21:09:16.834437 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 21:09:16.835263 20282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 21:09:16.830903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35400 (local address 127.15.37.62:40069)
0810 21:09:16.831226 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0810 21:09:16.831228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 21:09:16.831236 (+ 8us) server_negotiation.cc:407] Connection header received
0810 21:09:16.831282 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 21:09:16.831282 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 21:09:16.831343 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 21:09:16.831447 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 21:09:16.832578 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:16.833126 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:16.834230 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 21:09:16.834556 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 21:09:16.834624 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 21:09:16.834886 (+ 262us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 21:09:16.835021 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 21:09:16.835084 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 21:09:16.835138 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 21:09:16.835168 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":63,"threads_started":1}
I20260810 21:09:16.837255 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 19698
I20260810 21:09:16.853207 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 19818
I20260810 21:09:16.869642 15508 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskEugCJs/build/release/bin/kudu with pid 19943
2026-08-10T21:09:16Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3168 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6328 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (301868 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST